Jul 07 03:26:37 devstack cinder-volume[75685]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 03:26:37 devstack cinder-volume[75685]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 03:26:37 devstack cinder-volume[75685]: we strongly recommend against using it for new projects.
Jul 07 03:26:37 devstack cinder-volume[75685]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 03:26:37 devstack cinder-volume[75685]: framework.  For more detail see
Jul 07 03:26:37 devstack cinder-volume[75685]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 03:26:37 devstack cinder-volume[75685]:   import eventlet  # noqa
Jul 07 03:26:39 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:26:39 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:26:39 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:26:40 devstack cinder-volume[75685]: INFO dbcounter [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Registered counter for database cinder
Jul 07 03:26:40 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:26:40 devstack cinder-volume[75685]: DEBUG dbcounter [-] [75685] Writer thread running {{(pid=75685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:26:40 devstack cinder-volume[75685]: INFO cinder.rpc [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 03:26:40 devstack cinder-volume[75685]: INFO cinder.rpc [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 03:26:40 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Determined volume DB was empty at startup.
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG cinder.volume.manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75685) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 03:26:41 devstack cinder-volume[75685]: WARNING stevedore.named [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 03:26:41 devstack cinder-volume[75685]: WARNING castellan.key_manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:26:41 devstack cinder-volume[75685]: WARNING cinder.keymgr.conf_key_mgr [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG cinder.volume.drivers.lvm [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75685) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_concurrency.processutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_concurrency.processutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] CMD "cinder-rtstool verify" returned: 0 in 0.478s {{(pid=75685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO cinder.rpc [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO cinder.rpc [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 07 03:26:41 devstack cinder-volume[75685]: WARNING stevedore.named [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 03:26:41 devstack cinder-volume[75685]: WARNING castellan.key_manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:26:41 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Starting 1 workers
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Started child 75862 {{(pid=75685) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Full set of CONF: {{(pid=75685) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] ******************************************************************************** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Configuration options gathered from: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 03:26:41 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] ================================================================================ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] allow_availability_zone_fallback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] allow_compression_on_image_upload = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] allowed_direct_url_schemes     = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] api_rate_limit                 = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75862]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] auth_strategy                  = keystone {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] az_cache_duration              = 3600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_availability_zone      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_host                   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_name                   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_stats_polling_interval = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backup_api_class               = cinder.backup.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backup_name_template           = backup-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backup_use_same_host           = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backup_use_temp_snapshot       = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] chap_password                  = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] chap_username                  =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_internal_tenant_project_id = 4d8a49a23a1a42d5b878b8641fb2abfb {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_internal_tenant_user_id = e97ac0f41ddb422b90633115932f6820 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cloned_volume_same_az          = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cluster                        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] compression_format             = gzip {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] config_dir                     = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] config_source                  = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] control_exchange               = openstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] debug                          = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] default_availability_zone      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] default_group_type             = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] default_volume_type            = lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] disk_geometry                  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_client_cert             = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_client_cert_key         = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_data_namespace          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_ssl_cert_path           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_ssl_cert_verify         = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] driver_use_ssl                 = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] enable_force_upload            = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] enable_new_services            = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] enable_unsupported_driver      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] enforce_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] filter_function                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_api_insecure            = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_api_servers             = ['http://192.168.122.61/image'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_api_ssl_compression     = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_ca_certificates_file    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_certfile                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_keyfile                 = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_num_retries             = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance_request_timeout         = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] goodness_function              = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] graceful_shutdown_timeout      = 5 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] group_api_class                = cinder.group.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] host                           = devstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_compress_on_upload       = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_conversion_address_space_limit = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_conversion_cpu_limit     = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_conversion_disable       = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_upload_use_cinder_backend = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_upload_use_internal_tenant = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_volume_cache_enabled     = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_volume_cache_max_count   = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] image_volume_cache_max_size_gb = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] init_host_max_objects_retrieval = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iscsi_target_flags             =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack sudo[75866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iscsi_write_cache              = on {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iser_helper                    = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iser_ip_address                = 192.168.122.61 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iser_port                      = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_color                      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_config_append              = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack sudo[75866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_dir                        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_file                       = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_options                    = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_rotate_interval            = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_rotate_interval_type       = days {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] log_rotation_type              = none {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75862]: INFO cinder.volume.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] max_age                        = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] max_logfile_count              = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] max_logfile_size_mb            = 200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] max_over_subscription_ratio    = 20.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] message_reap_interval          = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] message_ttl                    = 2592000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] migration_create_volume_timeout_secs = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] monkey_patch                   = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] monkey_patch_modules           = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] my_ip                          = 192.168.122.61 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] no_snapshot_gb_quota           = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] num_iser_scan_tries            = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] num_shell_tries                = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] num_volume_device_scan_tries   = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] nvmeof_conn_info_version       = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] nvmet_ns_id                    = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] nvmet_port_id                  = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_max_limit                = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_ext_list          = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_listen_port       = 8776 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_use_ssl           = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] osapi_volume_workers           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] per_volume_size_limit          = -1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] periodic_fuzzy_delay           = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] periodic_interval              = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] public_endpoint                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] publish_errors                 = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_backup_gigabytes         = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_backups                  = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_gigabytes                = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_groups                   = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_snapshots                = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] quota_volumes                  = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] rate_limit_burst               = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] rate_limit_except_level        = CRITICAL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] rate_limit_interval            = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] reinit_driver_count            = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] replication_device             = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] report_discard_supported       = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] report_interval                = 120 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] reservation_clean_interval     = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] reservation_expire             = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] reserved_image_namespaces      = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] reserved_percentage            = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] rpc_response_timeout           = 120 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] run_external_periodic_tasks    = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] scst_target_driver             = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] scst_target_iqn_name           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_down_time              = 720 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] shell_completion               = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] snapshot_name_template         = snapshot-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] snapshot_same_host             = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] split_loggers                  = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] state_path                     = /opt/stack/data/cinder {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] storage_availability_zone      = nova {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] storage_protocol               = iSCSI {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] syslog_log_facility            = LOG_USER {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_helper                  = lioadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_ip_address              = 192.168.122.61 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_port                    = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_protocol                = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] target_secondary_ip_addresses  = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] trace_flags                    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] transport_url                  = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] until_refresh                  = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_chap_auth                  = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_default_quota_class        = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_journal                    = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_json                       = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_multipath_for_image_xfer   = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_stderr                     = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] use_syslog                     = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] verify_glance_signatures       = enabled {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_api_class               = cinder.volume.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_backend_name            = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_clear                   = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_clear_ionice            = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_clear_size              = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_copy_bps_limit          = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_dd_blocksize            = 1M {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_name_template           = volume-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_service_inithost_offload = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volume_usage_audit_period      = month {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] zoning_mode                    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_concurrency.disable_process_locking = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.auth_type   = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.auth_version = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.cache       = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.certfile    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.include_service_catalog = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.insecure    = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.interface   = public {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.keyfile     = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_password =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcache_username =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.region_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.service_type = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.61/identity {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.backend                  = dogpile.cache.null {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.backend_argument         = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.backend_expiration_time  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.config_prefix            = cache.oslo {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.debug_cache_backend      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.enable_retry_client      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.enable_socket_keepalive  = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.enabled                  = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.expiration_time          = 600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.hashclient_retry_attempts = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_dead_retry      = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_sasl_enabled    = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.password                 = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.proxies                  = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.redis_db                 = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.redis_server             = localhost:6379 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.retry_attempts           = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.retry_delay              = 0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.socket_keepalive_count   = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.socket_keepalive_idle    = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.socket_keepalive_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.socket_timeout           = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.tls_allowed_ciphers      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.tls_cafile               = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.tls_certfile             = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.tls_enabled              = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.tls_keyfile              = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cache.username                 = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] coordination.backend_url       = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.asyncio_connection    = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.asyncio_slave_connection = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.backend               = sqlalchemy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.connection            = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.connection_debug      = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.connection_parameters =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.connection_recycle_time = 3600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.connection_trace      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.db_inc_retry_interval = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.db_max_retries        = 20 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.db_max_retry_interval = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.db_retry_interval     = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.max_overflow          = 50 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.max_pool_size         = 5 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.max_retries           = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.mysql_wsrep_sync_wait = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.pool_timeout          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.retry_interval        = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.slave_connection      = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.sqlite_synchronous    = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.synchronous_reader    = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] database.use_db_reconnect      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.connection_string     = messaging:// {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.enabled               = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.es_doc_type           = notification {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.es_scroll_size        = 10000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.es_scroll_time        = 2m {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.filter_error_trace    = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.hmac_keys             = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.sentinel_service_name = mymaster {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.socket_timeout        = 0.1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.trace_requests        = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler.trace_sqlalchemy      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler_jaeger.process_tags   = {} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler_jaeger.service_name_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] profiler_otlp.service_name_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.enforce_new_defaults = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.enforce_scope      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.policy_default_rule = default {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.group          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.helper_command = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] privsep_osbrick.user           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.group         = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.helper_command = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] cinder_sys_admin.user          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.auth_section      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.auth_type         = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.cafile            = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.certfile          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.collect_timing    = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.insecure          = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.keyfile           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.send_service_user_token = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.split_loggers     = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] service_user.timeout           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.auth_section            = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.auth_type               = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.certfile                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.collect_timing          = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.insecure                = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.keyfile                 = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.region_name             = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.split_loggers           = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] glance.timeout                 = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.backend_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.chap_password = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.chap_username =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.disk_geometry = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_client_cert = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_client_cert_key = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_data_namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.driver_use_ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.extra_capabilities = {} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.filter_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.goodness_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iscsi_target_flags =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iscsi_write_cache = on {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iser_ip_address = 192.168.122.61 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iser_port     = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.lvm_share_target = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.lvm_type      = auto {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.num_shell_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.replication_device = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.report_discard_supported = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.reserved_percentage = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_helper = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_ip_address = 192.168.122.61 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_port   = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_protocol = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.trace_flags   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.unique_fqdn_network = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.use_chap_auth = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_backend_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_clear  = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_clear_ionice = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_clear_size = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_reports.file_event_handler = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_reports.log_dir           = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.backend_host       = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.chap_password      = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.chap_username      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.disk_geometry      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_client_cert = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.extra_capabilities = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.filter_function    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.goodness_function  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iser_helper        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iser_port          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.lvm_type           = auto {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.replication_device = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.report_discard_supported = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.reserved_percentage = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.scst_target_driver = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.storage_protocol   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_ip_address  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_port        = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.trace_flags        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_clear       = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] lvmdriver-1.volumes_dir        = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_notifications.driver = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_notifications.retry = -1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] key_manager.fixed_key          = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.barbican_api_version  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.barbican_endpoint     = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.barbican_endpoint_type = public {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.barbican_region_name  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.cafile                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.certfile              = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.collect_timing        = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.insecure              = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.keyfile               = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.number_of_retries     = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.retry_delay           = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.send_service_user_token = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.split_loggers         = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.timeout               = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.verify_ssl            = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican.verify_ssl_path       = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.auth_type = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.cafile   = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.collect_timing = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.keyfile  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] barbican_service_user.timeout  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.approle_role_id          = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.approle_secret_id        = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.kv_mountpoint            = secret {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.kv_path                  = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.kv_version               = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.namespace                = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.root_token_id            = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.ssl_ca_crt_file          = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.timeout                  = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.use_ssl                  = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:26:42 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] ******************************************************************************** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 03:26:42 devstack sudo[75866]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:42 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:42 devstack sudo[76056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:42 devstack sudo[76056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:43 devstack sudo[76056]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:43 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.645s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:43 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:26:43 devstack cinder-volume[75862]: INFO cinder.brick.local_dev.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 07 03:26:43 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:43 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:43 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:43 devstack sudo[76255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:43 devstack sudo[76255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:44 devstack sudo[76255]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:44 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:44 devstack cinder-volume[75862]: DEBUG cinder.brick.local_dev.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75862) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 07 03:26:44 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:44 devstack sudo[76431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:44 devstack sudo[76431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:45 devstack sudo[76431]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:45 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.085s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:45 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:45 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:45 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:45 devstack sudo[76616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:45 devstack sudo[76616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:46 devstack sudo[76616]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.768s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:46 devstack sudo[76646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 07 03:26:46 devstack sudo[76646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:46 devstack sudo[76646]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.689s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:46 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:46 devstack sudo[76650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:46 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:47 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:47 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:47 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:47 devstack sudo[76662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:47 devstack sudo[76662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:48 devstack sudo[76662]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:48 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:48 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:48 devstack sudo[76666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:48 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:49 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:49 devstack sudo[76672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:49 devstack sudo[76672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:49 devstack sudo[76672]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.880s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:49 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:49 devstack sudo[76677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:49 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:50 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:50 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.711s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:50 devstack cinder-volume[75862]: INFO cinder.volume.drivers.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 07 03:26:50 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:50 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:50 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:50 devstack sudo[76689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:50 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:51 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:51 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.746s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:51 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:26:51 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:51 devstack sudo[76813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:51 devstack sudo[76813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:51 devstack cinder-volume[75685]: DEBUG dbcounter [-] [75685] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:26:52 devstack sudo[76813]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:52 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:52 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:52 devstack sudo[76817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:52 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:52 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:52 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:52 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:52 devstack sudo[76957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:52 devstack sudo[76957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:53 devstack sudo[76957]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:53 devstack sudo[76960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:53 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:54 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:54 devstack cinder-volume[75862]: INFO cinder.volume.driver [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG cinder.volume.driver [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75862) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG oslo_db.sqlalchemy.engines [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writer thread running {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG cinder.db.api [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Building query based on filter {{(pid=75862) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG cinder.image.image_utils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75862) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 03:26:54 devstack cinder-volume[75862]: INFO cinder.keymgr.migration [None req-1fb9c72b-00b1-4c6b-9442-7cafc3eb3fbc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:54 devstack sudo[76965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:54 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:54 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:54 devstack sudo[76971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:54 devstack sudo[76971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:55 devstack sudo[76971]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:55 devstack sudo[76975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:55 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:56 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.660s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:56 devstack sudo[76978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:56 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:56 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG cinder.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Notifying Schedulers of capabilities ... {{(pid=75862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:26:56 devstack cinder-volume[75862]: INFO cinder.volume.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Driver initialization completed successfully.
Jul 07 03:26:56 devstack cinder-volume[75862]: INFO cinder.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Initiating service 2 cleanup
Jul 07 03:26:56 devstack cinder-volume[75862]: INFO cinder.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Service 2 cleanup completed.
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG cinder.service [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Creating RPC server for service cinder-volume {{(pid=75862) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 03:26:56 devstack cinder-volume[75862]: DEBUG cinder.service [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75862) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 03:26:57 devstack cinder-volume[75862]: INFO cinder.volume.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 07 03:26:57 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:26:57 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:57 devstack sudo[76982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:26:57 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:57 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:57 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:57 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:57 devstack sudo[76986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:57 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:58 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:58 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:58 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:58 devstack sudo[76993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:26:58 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:59 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:59 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:59 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:26:59 devstack sudo[77050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:26:59 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:26:59 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root
Jul 07 03:26:59 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:26:59 devstack cinder-volume[75862]: INFO cinder.volume.manager [None req-0c42718c-c559-49e6-af5e-582ddabdbab5 None None] Driver post RPC initialization completed successfully.
Jul 07 03:27:09 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writing DB stats cinder:SELECT=3 {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:27:09 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:27:53 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:27:53 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:27:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:27:53 devstack sudo[78737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:27:53 devstack sudo[78737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:27:54 devstack sudo[78737]: pam_unix(sudo:session): session closed for user root
Jul 07 03:27:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:27:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:27:54 devstack sudo[78740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:27:54 devstack sudo[78740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:27:55 devstack sudo[78740]: pam_unix(sudo:session): session closed for user root
Jul 07 03:27:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:27:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:27:55 devstack sudo[78743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:27:55 devstack sudo[78743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:27:55 devstack sudo[78743]: pam_unix(sudo:session): session closed for user root
Jul 07 03:27:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:27:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:27:55 devstack sudo[78746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:27:55 devstack sudo[78746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:27:56 devstack sudo[78746]: pam_unix(sudo:session): session closed for user root
Jul 07 03:27:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:27:56 devstack cinder-volume[75862]: DEBUG cinder.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Notifying Schedulers of capabilities ... {{(pid=75862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:27:56 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager._thread_info {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:27:56 devstack cinder-volume[75862]: DEBUG cinder.volume.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] thread count: 6 {{(pid=75862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:27:56 devstack cinder-volume[75862]: DEBUG cinder.volume.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] thread info: [<_MainThread(MainThread, started 127029966016640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127029856000064)>, <Thread(Thread-3 (stat_writer), started daemon 127029853308992)>, <Thread(Rabbit-heartbeat, started daemon 127029853850112)>, <Thread(Thread-5 (_runner), started daemon 127029853996544)>, <Thread(Thread-7 (_runner), started daemon 127029852003904)>] {{(pid=75862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:28:53 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:28:53 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:28:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:28:53 devstack sudo[82008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:28:53 devstack sudo[82008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:28:54 devstack sudo[82008]: pam_unix(sudo:session): session closed for user root
Jul 07 03:28:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:28:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:28:54 devstack sudo[82013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:28:54 devstack sudo[82013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:28:55 devstack sudo[82013]: pam_unix(sudo:session): session closed for user root
Jul 07 03:28:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:28:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:28:55 devstack sudo[82021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:28:55 devstack sudo[82021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:28:55 devstack sudo[82021]: pam_unix(sudo:session): session closed for user root
Jul 07 03:28:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:28:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:28:55 devstack sudo[82032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:28:55 devstack sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:28:56 devstack sudo[82032]: pam_unix(sudo:session): session closed for user root
Jul 07 03:28:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:28:56 devstack cinder-volume[75862]: DEBUG cinder.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Notifying Schedulers of capabilities ... {{(pid=75862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:29:09 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writing DB stats cinder:SELECT=1 {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:29:09 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writing DB stats cinder:UPDATE=1 {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:29:53 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:29:53 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:29:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:29:53 devstack sudo[83953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:29:53 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:29:54 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root
Jul 07 03:29:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:29:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:29:54 devstack sudo[83976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:29:54 devstack sudo[83976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:29:55 devstack sudo[83976]: pam_unix(sudo:session): session closed for user root
Jul 07 03:29:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:29:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:29:55 devstack sudo[83992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:29:55 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:29:55 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root
Jul 07 03:29:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:29:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:29:55 devstack sudo[84018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:29:55 devstack sudo[84018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:29:56 devstack sudo[84018]: pam_unix(sudo:session): session closed for user root
Jul 07 03:29:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.747s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:29:56 devstack cinder-volume[75862]: DEBUG cinder.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Notifying Schedulers of capabilities ... {{(pid=75862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:29:56 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager._thread_info {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:29:56 devstack cinder-volume[75862]: DEBUG cinder.volume.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] thread count: 6 {{(pid=75862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:29:56 devstack cinder-volume[75862]: DEBUG cinder.volume.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] thread info: [<_MainThread(MainThread, started 127029966016640)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127029856000064)>, <Thread(Thread-3 (stat_writer), started daemon 127029853308992)>, <Thread(Rabbit-heartbeat, started daemon 127029853850112)>, <Thread(Thread-5 (_runner), started daemon 127029853996544)>, <Thread(Thread-7 (_runner), started daemon 127029852003904)>] {{(pid=75862) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:30:53 devstack cinder-volume[75862]: DEBUG oslo_service.periodic_task [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75862) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:30:53 devstack cinder-volume[75862]: DEBUG cinder.volume.drivers.lvm [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Updating volume stats {{(pid=75862) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 03:30:53 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:30:53 devstack sudo[85328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 03:30:53 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:30:54 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root
Jul 07 03:30:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:30:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:30:54 devstack sudo[85338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:30:54 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:30:54 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root
Jul 07 03:30:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:30:54 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:30:55 devstack sudo[85361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 03:30:55 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:30:55 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root
Jul 07 03:30:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:30:55 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:30:55 devstack sudo[85366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 03:30:55 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:30:56 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root
Jul 07 03:30:56 devstack cinder-volume[75862]: DEBUG oslo_concurrency.processutils [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.683s {{(pid=75862) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:30:56 devstack cinder-volume[75862]: DEBUG cinder.manager [None req-77684c97-6896-403a-b9c0-12b19f8d5dd3 None None] Notifying Schedulers of capabilities ... {{(pid=75862) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:31:09 devstack cinder-volume[75862]: DEBUG dbcounter [-] [75862] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:20 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Caught SIGTERM, stopping children
Jul 07 03:31:20 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Acquiring lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:20 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Acquired lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:20 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Releasing lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Stop services. {{(pid=75685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 03:31:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Killing children. {{(pid=75685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 03:31:20 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Waiting on 1 children to exit
Jul 07 03:31:22 devstack cinder-volume[75862]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Acquiring lock "singleton_lock" {{(pid=75862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:22 devstack cinder-volume[75862]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Acquired lock "singleton_lock" {{(pid=75862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:22 devstack cinder-volume[75862]: DEBUG oslo_concurrency.lockutils [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Releasing lock "singleton_lock" {{(pid=75862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:22 devstack cinder-volume[75862]: WARNING amqp [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 03:31:22 devstack cinder-volume[75862]: WARNING amqp [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 03:31:22 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-b9f36351-d60f-49bd-a4e1-35fd60cc6d09 None None] Child 75862 exited with status 0
Jul 07 03:31:22 devstack cinder-volume[85959]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 03:31:22 devstack cinder-volume[85959]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 03:31:22 devstack cinder-volume[85959]: we strongly recommend against using it for new projects.
Jul 07 03:31:22 devstack cinder-volume[85959]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 03:31:22 devstack cinder-volume[85959]: framework.  For more detail see
Jul 07 03:31:22 devstack cinder-volume[85959]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 03:31:22 devstack cinder-volume[85959]:   import eventlet  # noqa
Jul 07 03:31:24 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:24 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:24 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO dbcounter [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Registered counter for database cinder
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_db.sqlalchemy.engines [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85959) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG dbcounter [-] [85959] Writer thread running {{(pid=85959) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO cinder.rpc [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO cinder.rpc [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_db.sqlalchemy.engines [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85959) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO cinder.volume.manager [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Determined volume DB was empty at startup.
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG cinder.volume.manager [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85959) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO cinder.volume.manager [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 03:31:25 devstack cinder-volume[85959]: WARNING stevedore.named [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 03:31:25 devstack cinder-volume[85959]: WARNING castellan.key_manager [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:31:25 devstack cinder-volume[85959]: WARNING cinder.keymgr.conf_key_mgr [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO cinder.volume.manager [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_db.sqlalchemy.engines [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85959) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:25 devstack cinder-volume[85959]: INFO oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Starting 1 workers
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Started child 86176 {{(pid=85959) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Full set of CONF: {{(pid=85959) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] ******************************************************************************** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Configuration options gathered from: {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] ================================================================================ {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] allow_availability_zone_fallback = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] allow_compression_on_image_upload = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] allowed_direct_url_schemes     = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] api_rate_limit                 = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] auth_strategy                  = keystone {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[86176]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_availability_zone      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_host                   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_name                   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_stats_polling_interval = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backup_api_class               = cinder.backup.api.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backup_name_template           = backup-%s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backup_use_same_host           = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backup_use_temp_snapshot       = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] chap_password                  = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] chap_username                  =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_internal_tenant_project_id = 4d8a49a23a1a42d5b878b8641fb2abfb {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_internal_tenant_user_id = e97ac0f41ddb422b90633115932f6820 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cluster                        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] compression_format             = gzip {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] config_dir                     = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] config_source                  = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] control_exchange               = openstack {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] debug                          = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] default_availability_zone      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] default_group_type             = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] default_volume_type            = QuobyteHD {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] disk_geometry                  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_client_cert             = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_client_cert_key         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_data_namespace          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_ssl_cert_path           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_ssl_cert_verify         = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] driver_use_ssl                 = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] enable_new_services            = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] enable_unsupported_driver      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] enforce_multipath_for_image_xfer = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] filter_function                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_api_insecure            = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_api_servers             = ['http://192.168.122.61/image'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_api_ssl_compression     = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_ca_certificates_file    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_certfile                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_keyfile                 = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_num_retries             = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance_request_timeout         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] goodness_function              = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] graceful_shutdown_timeout      = 5 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] group_api_class                = cinder.group.api.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] host                           = devstack {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_compress_on_upload       = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_conversion_address_space_limit = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_conversion_cpu_limit     = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_conversion_disable       = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_upload_use_cinder_backend = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_upload_use_internal_tenant = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_volume_cache_enabled     = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_volume_cache_max_count   = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] image_volume_cache_max_size_gb = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] init_host_max_objects_retrieval = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iscsi_target_flags             =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iscsi_write_cache              = on {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iser_helper                    = tgtadm {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iser_ip_address                = 192.168.122.61 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iser_port                      = 3260 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_color                      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_config_append              = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_dir                        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_file                       = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_options                    = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_rotate_interval            = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_rotate_interval_type       = days {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] log_rotation_type              = none {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[86176]: INFO cinder.volume.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] max_age                        = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] max_logfile_count              = 30 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] max_logfile_size_mb            = 200 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] max_over_subscription_ratio    = 20.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] message_reap_interval          = 86400 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] message_ttl                    = 2592000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] migration_create_volume_timeout_secs = 300 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] monkey_patch                   = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] monkey_patch_modules           = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] my_ip                          = 192.168.122.61 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] no_snapshot_gb_quota           = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] num_iser_scan_tries            = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] num_shell_tries                = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] num_volume_device_scan_tries   = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] nvmeof_conn_info_version       = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] nvmet_ns_id                    = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] nvmet_port_id                  = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_max_limit                = 1000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_ext_list          = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_listen_port       = 8776 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.remotefs [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86176) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_use_ssl           = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] osapi_volume_workers           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] per_volume_size_limit          = -1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] periodic_fuzzy_delay           = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] periodic_interval              = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] public_endpoint                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] publish_errors                 = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_backup_gigabytes         = 1000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_backups                  = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_gigabytes                = 1000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_groups                   = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_snapshots                = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] quota_volumes                  = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] rate_limit_burst               = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] rate_limit_except_level        = CRITICAL {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] rate_limit_interval            = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] reinit_driver_count            = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] replication_device             = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] report_discard_supported       = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] report_interval                = 120 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] reservation_clean_interval     = 86400 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] reservation_expire             = 86400 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] reserved_image_namespaces      = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] reserved_percentage            = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] rpc_response_timeout           = 120 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] run_external_periodic_tasks    = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] scst_target_driver             = iscsi {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] scst_target_iqn_name           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_down_time              = 720 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] shell_completion               = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] snapshot_name_template         = snapshot-%s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] split_loggers                  = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] state_path                     = /opt/stack/data/cinder {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] storage_availability_zone      = nova {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] storage_protocol               = iSCSI {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] syslog_log_facility            = LOG_USER {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_helper                  = lioadm {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_ip_address              = 192.168.122.61 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_port                    = 3260 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_protocol                = iscsi {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] target_secondary_ip_addresses  = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] trace_flags                    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] transport_url                  = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] until_refresh                  = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_chap_auth                  = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_default_quota_class        = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:25 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_journal                    = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_json                       = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_multipath_for_image_xfer   = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_stderr                     = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] use_syslog                     = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] verify_glance_signatures       = enabled {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_api_class               = cinder.volume.api.API {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_backend_name            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_clear                   = zero {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_clear_ionice            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_clear_size              = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_copy_bps_limit          = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_dd_blocksize            = 1M {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_name_template           = volume-%s {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_service_inithost_offload = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volume_usage_audit_period      = month {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] zoning_mode                    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_concurrency.disable_process_locking = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.auth_section = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.auth_type   = password {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.auth_version = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.cache       = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.certfile    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.include_service_catalog = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.insecure    = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.interface   = public {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.keyfile     = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_password =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcache_username =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.region_name = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.service_type = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.61/identity {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.backend                  = dogpile.cache.null {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.backend_argument         = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.backend_expiration_time  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.config_prefix            = cache.oslo {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.debug_cache_backend      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.enable_retry_client      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.enable_socket_keepalive  = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.enabled                  = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.expiration_time          = 600 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.hashclient_retry_attempts = 2 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_dead_retry      = 300 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_sasl_enabled    = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.password                 = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.proxies                  = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.redis_db                 = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.redis_server             = localhost:6379 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.retry_attempts           = 2 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.retry_delay              = 0.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.socket_keepalive_count   = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.socket_keepalive_idle    = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.socket_keepalive_interval = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.socket_timeout           = 1.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.tls_allowed_ciphers      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.tls_cafile               = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.tls_certfile             = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.tls_enabled              = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.tls_keyfile              = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cache.username                 = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] coordination.backend_url       = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.asyncio_connection    = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.asyncio_slave_connection = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.backend               = sqlalchemy {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.connection            = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.connection_debug      = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.connection_parameters =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.connection_recycle_time = 3600 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.connection_trace      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.db_inc_retry_interval = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.db_max_retries        = 20 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.db_max_retry_interval = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.db_retry_interval     = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.max_overflow          = 50 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.max_pool_size         = 5 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.max_retries           = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.mysql_wsrep_sync_wait = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.pool_timeout          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.retry_interval        = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.slave_connection      = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.sqlite_synchronous    = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.synchronous_reader    = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] database.use_db_reconnect      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.connection_string     = messaging:// {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.enabled               = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.es_doc_type           = notification {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.es_scroll_size        = 10000 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.es_scroll_time        = 2m {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.filter_error_trace    = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.hmac_keys             = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.sentinel_service_name = mymaster {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.socket_timeout        = 0.1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.trace_requests        = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler.trace_sqlalchemy      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler_jaeger.process_tags   = {} {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler_jaeger.service_name_prefix = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] profiler_otlp.service_name_prefix = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.enforce_new_defaults = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.enforce_scope      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.policy_default_rule = default {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.group          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.helper_command = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] privsep_osbrick.user           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.group         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.helper_command = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] cinder_sys_admin.user          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.auth_section      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.auth_type         = password {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.cafile            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.certfile          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.collect_timing    = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.insecure          = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.keyfile           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.send_service_user_token = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.split_loggers     = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] service_user.timeout           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.auth_section            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.auth_type               = password {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.certfile                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.collect_timing          = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.insecure                = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.keyfile                 = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.region_name             = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.split_loggers           = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] glance.timeout                 = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.backend_availability_zone = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.chap_password = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.chap_username =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.disk_geometry = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_client_cert = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_client_cert_key = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_data_namespace = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.driver_use_ssl = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.extra_capabilities = {} {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.filter_function = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.goodness_function = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iscsi_target_flags =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iscsi_write_cache = on {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iser_ip_address = 192.168.122.61 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iser_port     = 3260 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_host      =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_login     = admin {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_mount_options = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_password  = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_private_key =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_share_path =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.num_shell_tries = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.quobyte_volume_url = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.replication_device = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.report_discard_supported = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.reserved_percentage = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_helper = tgtadm {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_ip_address = 192.168.122.61 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_port   = 3260 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_protocol = iscsi {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.trace_flags   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.unique_fqdn_network = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.use_chap_auth = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_backend_name = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_clear  = zero {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_clear_ionice = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_clear_size = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_reports.file_event_handler = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_reports.log_dir           = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.backend_availability_zone = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.backend_host         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.chap_password        = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.chap_username        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.disk_geometry        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_client_cert   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_data_namespace = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.extra_capabilities   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.filter_function      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.goodness_function    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iser_helper          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iser_ip_address      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iser_port            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_host             = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_login            = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_mount_options    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_password         = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_private_key      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_share_path       = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.num_shell_tries      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86176) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 03:31:26 devstack cinder-volume[86176]: WARNING cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 03:31:26 devstack cinder-volume[86176]: WARNING cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Running cmd (subprocess): mount.quobyte {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.replication_device   = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.report_discard_supported = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.reserved_percentage  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.scst_target_driver   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.storage_protocol     = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_helper        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_ip_address    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_port          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_prefix        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_protocol      = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.trace_flags          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.use_chap_auth        = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_clear         = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_clear_size    = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] QuobyteHD.volumes_dir          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_notifications.driver = [] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_notifications.retry = -1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] key_manager.fixed_key          = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.barbican_api_version  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.barbican_endpoint     = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.barbican_endpoint_type = public {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.barbican_region_name  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.cafile                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.certfile              = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.collect_timing        = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.insecure              = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.keyfile               = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.number_of_retries     = 60 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.retry_delay           = 1 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.send_service_user_token = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.split_loggers         = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.timeout               = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.verify_ssl            = True {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican.verify_ssl_path       = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.auth_section = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.auth_type = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.cafile   = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.certfile = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.collect_timing = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.insecure = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.keyfile  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.split_loggers = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] barbican_service_user.timeout  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.approle_role_id          = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.approle_secret_id        = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.kv_mountpoint            = secret {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.kv_path                  = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.kv_version               = 2 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.namespace                = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.root_token_id            = **** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.ssl_ca_crt_file          = None {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.timeout                  = 60.0 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.use_ssl                  = False {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:26 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] ******************************************************************************** {{(pid=85959) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 03:31:26 devstack quobyte-client[86181]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 03:31:26 devstack quobyte-client[86181]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:26 devstack cinder-volume[86176]: INFO cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 ...
Jul 07 03:31:26 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 -c /etc/quobyte/client-cinder.cfg {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:26 devstack sudo[86182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 -c /etc/quobyte/client-cinder.cfg
Jul 07 03:31:26 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:27 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.758s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:27 devstack cinder-volume[86176]: INFO cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 succeeded
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.772s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:27 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:27 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:27 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.666s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:27 devstack cinder-volume[86176]: INFO cinder.volume.driver [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.volume.driver [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86176) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_db.sqlalchemy.engines [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86176) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG dbcounter [-] [86176] Writer thread running {{(pid=86176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.db.api [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Building query based on filter {{(pid=86176) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.image.image_utils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86176) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 03:31:27 devstack cinder-volume[86176]: INFO cinder.keymgr.migration [None req-9f106098-0d71-41aa-8797-d426ecc70937 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:27 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:27 devstack sudo[86258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:27 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:28 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.659s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG cinder.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Notifying Schedulers of capabilities ... {{(pid=86176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:31:28 devstack cinder-volume[86176]: INFO cinder.volume.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Driver initialization completed successfully.
Jul 07 03:31:28 devstack cinder-volume[86176]: INFO cinder.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Initiating service 3 cleanup
Jul 07 03:31:28 devstack cinder-volume[86176]: INFO cinder.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Service 3 cleanup completed.
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG cinder.service [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Creating RPC server for service cinder-volume {{(pid=86176) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG cinder.service [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86176) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 03:31:28 devstack cinder-volume[86176]: INFO cinder.volume.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:28 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:28 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:28 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:29 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:29 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.927s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:29 devstack cinder-volume[86176]: INFO cinder.volume.manager [None req-52b367a3-e065-4b73-9b30-9f039522f839 None None] Driver post RPC initialization completed successfully.
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86176) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG cinder.volume.drivers.quobyte [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86176) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86176) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:33 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:33 devstack sudo[86506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:33 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:34 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:34 devstack cinder-volume[86176]: DEBUG oslo_concurrency.processutils [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.611s {{(pid=86176) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:34 devstack cinder-volume[86176]: DEBUG cinder.manager [None req-e8d36da0-a1ce-40c0-961d-c4a700b8c5f9 None None] Notifying Schedulers of capabilities ... {{(pid=86176) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:31:35 devstack cinder-volume[85959]: DEBUG dbcounter [-] [85959] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85959) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:36 devstack cinder-volume[85959]: INFO oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Caught SIGTERM, stopping children
Jul 07 03:31:36 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Acquiring lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:36 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Acquired lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:36 devstack cinder-volume[85959]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Releasing lock "singleton_lock" {{(pid=85959) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:36 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Stop services. {{(pid=85959) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 03:31:36 devstack cinder-volume[85959]: DEBUG oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Killing children. {{(pid=85959) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 03:31:36 devstack cinder-volume[85959]: INFO oslo_service.backend._eventlet.service [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Waiting on 1 children to exit
Jul 07 03:31:39 devstack cinder-volume[86176]: DEBUG dbcounter [-] [86176] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:39 devstack cinder-volume[86176]: DEBUG dbcounter [-] [86176] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86176) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:41 devstack cinder-volume[86176]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 07 03:31:41 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Acquiring lock "singleton_lock" {{(pid=86176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:41 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Acquired lock "singleton_lock" {{(pid=86176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:41 devstack cinder-volume[86176]: DEBUG oslo_concurrency.lockutils [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Releasing lock "singleton_lock" {{(pid=86176) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:41 devstack cinder-volume[86176]: WARNING amqp [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 03:31:41 devstack cinder-volume[86710]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 03:31:41 devstack cinder-volume[86710]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 03:31:41 devstack cinder-volume[86710]: we strongly recommend against using it for new projects.
Jul 07 03:31:41 devstack cinder-volume[86710]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 03:31:41 devstack cinder-volume[86710]: framework.  For more detail see
Jul 07 03:31:41 devstack cinder-volume[86710]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 03:31:41 devstack cinder-volume[86710]:   import eventlet  # noqa
Jul 07 03:31:41 devstack cinder-volume[86176]: WARNING amqp [None req-511ab050-603b-4e98-9ea4-6a02f96e6864 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 03:31:44 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 03:31:44 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 03:31:44 devstack cinder-volume[86710]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86710) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO dbcounter [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Registered counter for database cinder
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG dbcounter [-] [86710] Writer thread running {{(pid=86710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO cinder.rpc [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO cinder.rpc [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO cinder.volume.manager [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Determined volume DB was empty at startup.
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG cinder.volume.manager [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86710) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 03:31:45 devstack cinder-volume[86710]: WARNING stevedore.named [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 03:31:45 devstack cinder-volume[86710]: WARNING castellan.key_manager [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:31:45 devstack cinder-volume[86710]: WARNING cinder.keymgr.conf_key_mgr [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO cinder.volume.manager [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_db.sqlalchemy.engines [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:45 devstack cinder-volume[86710]: INFO oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Starting 1 workers
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Started child 86955 {{(pid=86710) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Full set of CONF: {{(pid=86710) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] ******************************************************************************** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] Configuration options gathered from: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] ================================================================================ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] allow_availability_zone_fallback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] allow_compression_on_image_upload = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86955]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] allowed_direct_url_schemes     = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] api_rate_limit                 = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] auth_strategy                  = keystone {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_availability_zone      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_host                   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_name                   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_stats_polling_interval = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backup_api_class               = cinder.backup.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backup_name_template           = backup-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backup_use_same_host           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backup_use_temp_snapshot       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] chap_password                  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] chap_username                  =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_internal_tenant_project_id = 4d8a49a23a1a42d5b878b8641fb2abfb {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_internal_tenant_user_id = e97ac0f41ddb422b90633115932f6820 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cluster                        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] compression_format             = gzip {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] config_dir                     = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] config_source                  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] control_exchange               = openstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] debug                          = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] default_availability_zone      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] default_group_type             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] default_volume_type            = QuobyteHD {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] disk_geometry                  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_client_cert             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_client_cert_key         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_data_namespace          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_ssl_cert_path           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_ssl_cert_verify         = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] driver_use_ssl                 = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] enable_new_services            = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] enable_unsupported_driver      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] enforce_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] filter_function                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_api_insecure            = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_api_servers             = ['http://192.168.122.61/image'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_api_ssl_compression     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_ca_certificates_file    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_certfile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_keyfile                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_num_retries             = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance_request_timeout         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] goodness_function              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] graceful_shutdown_timeout      = 5 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] group_api_class                = cinder.group.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] host                           = devstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_compress_on_upload       = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_conversion_address_space_limit = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_conversion_cpu_limit     = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_conversion_disable       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_upload_use_cinder_backend = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_upload_use_internal_tenant = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_volume_cache_enabled     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_volume_cache_max_count   = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:45 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] init_host_max_objects_retrieval = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iscsi_target_flags             =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iscsi_write_cache              = on {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iser_helper                    = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iser_ip_address                = 192.168.122.61 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iser_port                      = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_color                      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_config_append              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_dir                        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8935cb43-c361-4562-838c-a499d1179980 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86955) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_file                       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_options                    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_rotate_interval            = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_rotate_interval_type       = days {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] log_rotation_type              = none {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] max_age                        = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] max_logfile_count              = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] max_logfile_size_mb            = 200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] max_over_subscription_ratio    = 20.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] message_reap_interval          = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] message_ttl                    = 2592000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] monkey_patch                   = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] monkey_patch_modules           = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] my_ip                          = 192.168.122.61 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] no_snapshot_gb_quota           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] num_iser_scan_tries            = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] num_shell_tries                = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] num_volume_device_scan_tries   = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] nvmeof_conn_info_version       = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] nvmet_ns_id                    = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] nvmet_port_id                  = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_max_limit                = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_ext_list          = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_listen_port       = 8776 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_use_ssl           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] osapi_volume_workers           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] per_volume_size_limit          = -1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] periodic_fuzzy_delay           = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] periodic_interval              = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] public_endpoint                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] publish_errors                 = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_backup_gigabytes         = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_backups                  = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_gigabytes                = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_groups                   = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_snapshots                = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] quota_volumes                  = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] rate_limit_burst               = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] rate_limit_except_level        = CRITICAL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] rate_limit_interval            = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] reinit_driver_count            = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] replication_device             = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] report_discard_supported       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] report_interval                = 120 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] reservation_clean_interval     = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] reservation_expire             = 86400 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] reserved_image_namespaces      = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] reserved_percentage            = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] rpc_response_timeout           = 120 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] run_external_periodic_tasks    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] scst_target_driver             = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] scst_target_iqn_name           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_down_time              = 720 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] shell_completion               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] snapshot_name_template         = snapshot-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] split_loggers                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] state_path                     = /opt/stack/data/cinder {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] storage_availability_zone      = nova {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] storage_protocol               = iSCSI {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] syslog_log_facility            = LOG_USER {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_helper                  = lioadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_ip_address              = 192.168.122.61 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_port                    = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_protocol                = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] target_secondary_ip_addresses  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] trace_flags                    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] transport_url                  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] until_refresh                  = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_chap_auth                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_default_quota_class        = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_journal                    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_json                       = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_multipath_for_image_xfer   = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_stderr                     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] use_syslog                     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] verify_glance_signatures       = enabled {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_api_class               = cinder.volume.api.API {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_backend_name            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_clear                   = zero {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_clear_ionice            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_clear_size              = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_copy_bps_limit          = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_dd_blocksize            = 1M {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_name_template           = volume-%s {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_service_inithost_offload = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volume_usage_audit_period      = month {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] zoning_mode                    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.auth_section = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.auth_type   = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.auth_version = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.cache       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.certfile    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.insecure    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.interface   = public {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.keyfile     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_password =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcache_username =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.region_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.service_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.61/identity {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.backend                  = dogpile.cache.null {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.backend_argument         = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.backend_expiration_time  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.config_prefix            = cache.oslo {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.debug_cache_backend      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.enable_retry_client      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.enable_socket_keepalive  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.enabled                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.expiration_time          = 600 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_dead_retry      = 300 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_sasl_enabled    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.password                 = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.proxies                  = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.redis_db                 = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86955) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.redis_server             = localhost:6379 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.retry_attempts           = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.retry_delay              = 0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.socket_keepalive_count   = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.socket_keepalive_idle    = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.socket_keepalive_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.socket_timeout           = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.tls_allowed_ciphers      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.tls_cafile               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.tls_certfile             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.tls_enabled              = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.tls_keyfile              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cache.username                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] coordination.backend_url       = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Running cmd (subprocess): mount.quobyte {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.asyncio_connection    = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.asyncio_slave_connection = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.backend               = sqlalchemy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.connection            = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.connection_debug      = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.connection_parameters =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.connection_recycle_time = 3600 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.connection_trace      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.db_inc_retry_interval = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.db_max_retries        = 20 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.db_max_retry_interval = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.db_retry_interval     = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.max_overflow          = 50 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.max_pool_size         = 5 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.max_retries           = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.pool_timeout          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.retry_interval        = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.slave_connection      = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.sqlite_synchronous    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.synchronous_reader    = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] database.use_db_reconnect      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.connection_string     = messaging:// {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.enabled               = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.es_doc_type           = notification {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.es_scroll_size        = 10000 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.es_scroll_time        = 2m {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.filter_error_trace    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.hmac_keys             = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.sentinel_service_name = mymaster {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.socket_timeout        = 0.1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.trace_requests        = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler.trace_sqlalchemy      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler_jaeger.process_tags   = {} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] profiler_otlp.service_name_prefix = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.enforce_scope      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.policy_default_rule = default {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.group          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.helper_command = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] privsep_osbrick.user           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.group         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.helper_command = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] cinder_sys_admin.user          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.auth_section      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.auth_type         = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.cafile            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.certfile          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.collect_timing    = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.insecure          = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.keyfile           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.send_service_user_token = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.split_loggers     = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] service_user.timeout           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.auth_section            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.auth_type               = password {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.certfile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.collect_timing          = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.insecure                = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.keyfile                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.region_name             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.split_loggers           = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] glance.timeout                 = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.backend_availability_zone = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.chap_password = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.chap_username =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.disk_geometry = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_client_cert = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_data_namespace = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.driver_use_ssl = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.extra_capabilities = {} {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.filter_function = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.goodness_function = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iscsi_target_flags =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iser_ip_address = 192.168.122.61 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iser_port     = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_host      =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_login     = admin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_mount_options = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_password  = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_private_key =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_share_path =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack quobyte-client[86956]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack quobyte-client[86956]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.replication_device = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.report_discard_supported = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] CMD "mount.quobyte" returned: 1 in 0.047s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_helper = tgtadm {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_ip_address = 192.168.122.61 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_port   = 3260 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_protocol = iscsi {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.trace_flags   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.use_chap_auth = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_backend_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_clear  = zero {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_reports.file_event_handler = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_reports.log_dir           = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.backend_host         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.chap_password        = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.chap_username        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.disk_geometry        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_client_cert   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.extra_capabilities   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.filter_function      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.goodness_function    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iser_helper          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iser_ip_address      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iser_port            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_host             = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_login            = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_mount_options    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_password         = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_private_key      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_share_path       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.num_shell_tries      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.replication_device   = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.report_discard_supported = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.reserved_percentage  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.scst_target_driver   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.storage_protocol     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_helper        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_ip_address    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_port          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_prefix        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_protocol      = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.trace_flags          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.use_chap_auth        = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_clear         = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack sudo[86957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_clear_size    = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack sudo[86957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] QuobyteHD.volumes_dir          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_notifications.driver = [] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] key_manager.fixed_key          = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.barbican_api_version  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.barbican_endpoint     = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.barbican_endpoint_type = public {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.barbican_region_name  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.cafile                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.certfile              = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.collect_timing        = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.insecure              = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.keyfile               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.number_of_retries     = 60 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.retry_delay           = 1 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.send_service_user_token = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.split_loggers         = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.timeout               = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.verify_ssl            = True {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican.verify_ssl_path       = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.auth_section = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.auth_type = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.cafile   = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.certfile = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.collect_timing = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.insecure = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.keyfile  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.split_loggers = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] barbican_service_user.timeout  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.approle_role_id          = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.approle_secret_id        = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.kv_mountpoint            = secret {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.kv_path                  = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.kv_version               = 2 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.namespace                = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.root_token_id            = **** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.ssl_ca_crt_file          = None {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.timeout                  = 60.0 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.use_ssl                  = False {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 03:31:46 devstack cinder-volume[86710]: DEBUG oslo_service.backend._eventlet.service [None req-954f9328-e99a-4d56-b2b4-dcb3e78cf0f8 None None] ******************************************************************************** {{(pid=86710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 03:31:46 devstack sudo[86957]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.601s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:46 devstack cinder-volume[86955]: INFO cinder.volume.driver [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.driver [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_db.sqlalchemy.engines [None req-8935cb43-c361-4562-838c-a499d1179980 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writer thread running {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.db.api [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Building query based on filter {{(pid=86955) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86955) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:46 devstack cinder-volume[86955]: INFO cinder.keymgr.migration [None req-d7bb90c7-eea3-40ee-a874-d80440314ff7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 03:31:46 devstack sudo[86988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:46 devstack sudo[86988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:47 devstack sudo[86988]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.610s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:31:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Driver initialization completed successfully.
Jul 07 03:31:47 devstack cinder-volume[86955]: INFO cinder.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Initiating service 3 cleanup
Jul 07 03:31:47 devstack cinder-volume[86955]: INFO cinder.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Service 3 cleanup completed.
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG cinder.service [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Creating RPC server for service cinder-volume {{(pid=86955) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG cinder.service [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86955) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 03:31:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:31:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:31:47 devstack sudo[86994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:31:47 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:31:48 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root
Jul 07 03:31:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8935cb43-c361-4562-838c-a499d1179980 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.611s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:31:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8935cb43-c361-4562-838c-a499d1179980 None None] Driver post RPC initialization completed successfully.
Jul 07 03:31:55 devstack cinder-volume[86710]: DEBUG dbcounter [-] [86710] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:57 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:31:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:32:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:32:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 6 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:32:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Flow 'volume_create_manager' (df9b09af-6107-41a5-a466-62437e593726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124434d-a1c8-4f37-809a-a463c1442d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0124434d-a1c8-4f37-809a-a463c1442d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-330770655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53ca2f4-42f8-4df9-b268-35d158b2d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a2a78309db4342a05e4523dcf602dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:00Z,use_quota=True,user_id='b004d0eb81f34853b47ec1d7c3fcf311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6303c761-b992-45be-9193-0a559ce808fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6303c761-b992-45be-9193-0a559ce808fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceba198-9321-43d1-bee3-8ce9f9ed053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceba198-9321-43d1-bee3-8ce9f9ed053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f53ca2f4-42f8-4df9-b268-35d158b2d0c9', 'volume_name': 'volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c76a0d-342f-4220-8785-770dc3dff997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c76a0d-342f-4220-8785-770dc3dff997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36901d9f-5cdc-46f5-8894-cb07027ef225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Volume f53ca2f4-42f8-4df9-b268-35d158b2d0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9', 'volume_size': 1}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-330770655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53ca2f4-42f8-4df9-b268-35d158b2d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2a2a78309db4342a05e4523dcf602dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:00Z,use_quota=True,user_id='b004d0eb81f34853b47ec1d7c3fcf311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Creating volume f53ca2f4-42f8-4df9-b268-35d158b2d0c9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:33:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:33:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:00 devstack sudo[87489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 1073741824
Jul 07 03:33:00 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:03 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 1073741824" returned: 0 in 2.556s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:03 devstack sudo[87874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9
Jul 07 03:33:03 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:04 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" returned: 0 in 1.508s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] <== create_volume: return (4171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.173s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36901d9f-5cdc-46f5-8894-cb07027ef225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3125f4-19e0-4289-9eef-5a329794aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Volume volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 (f53ca2f4-42f8-4df9-b268-35d158b2d0c9): created successfully
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb3125f4-19e0-4289-9eef-5a329794aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Flow 'volume_create_manager' (df9b09af-6107-41a5-a466-62437e593726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7382994e-adb7-4baf-b8f7-ed5a566471e1 tempest-DeleteServersTestJSON-720978850 None] Created volume successfully.
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Flow 'volume_create_manager' (16a1e8df-074d-4b5a-9b94-c800ab665023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c966798-2933-453f-84ef-a7e073d06637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c966798-2933-453f-84ef-a7e073d06637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1732986658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec23254f-3fbe-4640-a301-5bf93cd686f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2bee9336fe41b7836a726ae034e63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:10Z,use_quota=True,user_id='2c15c5d2147944a6a5a6fc7e96db2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4d6e3-1da2-4867-85b2-28b1fedcc41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff4d6e3-1da2-4867-85b2-28b1fedcc41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ed7f6e-4339-4dfc-883a-20c16cc1f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64ed7f6e-4339-4dfc-883a-20c16cc1f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec23254f-3fbe-4640-a301-5bf93cd686f1', 'volume_name': 'volume-ec23254f-3fbe-4640-a301-5bf93cd686f1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6740455-3b97-43a7-b86a-365a85e64fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6740455-3b97-43a7-b86a-365a85e64fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2f2614-407c-464f-af61-215166ceca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Volume ec23254f-3fbe-4640-a301-5bf93cd686f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec23254f-3fbe-4640-a301-5bf93cd686f1', 'volume_size': 1}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1732986658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec23254f-3fbe-4640-a301-5bf93cd686f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2bee9336fe41b7836a726ae034e63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:10Z,use_quota=True,user_id='2c15c5d2147944a6a5a6fc7e96db2ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Creating volume ec23254f-3fbe-4640-a301-5bf93cd686f1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:33:10 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:33:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:10 devstack sudo[87901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 1073741824
Jul 07 03:33:10 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:11 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 1073741824" returned: 0 in 1.589s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:12 devstack sudo[87936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1
Jul 07 03:33:12 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:13 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1" returned: 0 in 1.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] <== create_volume: return (3055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.058s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2f2614-407c-464f-af61-215166ceca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec23254f-3fbe-4640-a301-5bf93cd686f1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62669678-e511-48db-8c44-e28edb44b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Volume volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 (ec23254f-3fbe-4640-a301-5bf93cd686f1): created successfully
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62669678-e511-48db-8c44-e28edb44b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Flow 'volume_create_manager' (16a1e8df-074d-4b5a-9b94-c800ab665023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e1c9129c-8d8d-47c6-a064-a52086dd5d85 tempest-VolumesAdminNegativeTest-215503888 None] Created volume successfully.
Jul 07 03:33:13 devstack cinder-volume[86955]: WARNING py.warnings [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 07 03:33:13 devstack cinder-volume[86955]:   .first()
Jul 07 03:33:13 devstack cinder-volume[86955]: 
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:13 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr25c3qr0/privsep.sock']
Jul 07 03:33:13 devstack sudo[87952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr25c3qr0/privsep.sock
Jul 07 03:33:13 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 03:33:14 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:15 devstack sudo[87955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:33:15 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 03:33:15 devstack cinder-volume[86955]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Acquiring lock "cinder-ec23254f-3fbe-4640-a301-5bf93cd686f1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "cinder-ec23254f-3fbe-4640-a301-5bf93cd686f1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:33:16 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:16 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Spawned new privsep daemon via rootwrap
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Accepted privsep connection to /tmp/tmpr25c3qr0/privsep.sock {{(pid=86955) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 07 03:33:16 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 07 03:33:16 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 07 03:33:16 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 07 03:33:16 devstack cinder-volume[86955]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87957
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Acquiring lock "cinder-quobyte-ec23254f-3fbe-4640-a301-5bf93cd686f1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e0b34b-d89e-4560-a0c8-85d2aa234c4e]: (2,) {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "cinder-quobyte-ec23254f-3fbe-4640-a301-5bf93cd686f1" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[866fc4ba-0026-4909-bce9-6b6adbb4ac02]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b84bc-2f8d-44fb-98a4-febe5aef7842]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:16 devstack sudo[87960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9
Jul 07 03:33:16 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:16 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1
Jul 07 03:33:16 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:16 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.581s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:33:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:33:17 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" returned: 0 in 1.181s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.788s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c86c703-eeee-4eaf-a1ca-3bddb8fd4daf', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:33:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-c7a1dfb2-7ba5-490a-98d2-8bf42002633a req-2c940f12-9ffd-4edb-be7b-748750d59f39 tempest-DeleteServersTestJSON-720978850 None] attachment_update completed successfully.
Jul 07 03:33:17 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1" returned: 0 in 1.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:17 devstack sudo[88007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1
Jul 07 03:33:17 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:18 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec23254f-3fbe-4640-a301-5bf93cd686f1" returned: 0 in 0.970s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "cinder-quobyte-ec23254f-3fbe-4640-a301-5bf93cd686f1" released by "delete_volume" :: held 2.436s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:33:19 devstack cinder-volume[86955]: WARNING cinder.quota [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:33:19 devstack cinder-volume[86955]: WARNING cinder.quota [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Created reservations ['62ac7456-f749-41bb-81e8-1d493ffb68d3', '83d19b5e-325c-43c0-9c0b-58fda4c1ecb0', 'b0d587c6-0147-4aec-8b5a-b9324ee2d733', 'eb7ca3f0-c1f9-4eb0-9bf6-622c524f15be'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:19 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:33:19 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:20 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.191s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:33:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Deleted volume successfully.
Jul 07 03:33:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dbc0a11-dbef-405f-9730-2f2a98a05720 tempest-VolumesAdminNegativeTest-215503888 None] Lock "cinder-ec23254f-3fbe-4640-a301-5bf93cd686f1-delete_volume" released by "delete_volume" :: held 4.119s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (05c50107-e199-4df0-a6e7-c8606def0070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bc0893-5efe-49ad-9112-0880dc612dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bc0893-5efe-49ad-9112-0880dc612dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1498585665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625e8791-c7a2-495b-91e3-08a1c43b8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:28Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb836808-692d-4c55-9485-c10af412beb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb836808-692d-4c55-9485-c10af412beb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3b8469-0dfc-4be7-b382-7ff9727b6286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3b8469-0dfc-4be7-b382-7ff9727b6286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625e8791-c7a2-495b-91e3-08a1c43b8710', 'volume_name': 'volume-625e8791-c7a2-495b-91e3-08a1c43b8710', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808d3728-5a8e-4cf8-88fb-319d1deacb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808d3728-5a8e-4cf8-88fb-319d1deacb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607dba71-ab74-44e6-8740-1829fd9ef516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Volume 625e8791-c7a2-495b-91e3-08a1c43b8710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625e8791-c7a2-495b-91e3-08a1c43b8710', 'volume_size': 1}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1498585665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625e8791-c7a2-495b-91e3-08a1c43b8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:33:28Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Creating volume 625e8791-c7a2-495b-91e3-08a1c43b8710 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:33:27 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:33:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:27 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 1073741824
Jul 07 03:33:27 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-744ef177-65f4-457e-9e2a-7bc34ed7a88f req-013e9f09-4986-45f0-979e-747c0ae7f3c5 tempest-DeleteServersTestJSON-720978850 None] Terminate volume connection completed successfully.
Jul 07 03:33:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-744ef177-65f4-457e-9e2a-7bc34ed7a88f req-013e9f09-4986-45f0-979e-747c0ae7f3c5 tempest-DeleteServersTestJSON-720978850 None] Deleting attachment 7c86c703-eeee-4eaf-a1ca-3bddb8fd4daf. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:33:28 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 1073741824" returned: 0 in 1.036s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:29 devstack sudo[88500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710
Jul 07 03:33:29 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:29 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710" returned: 0 in 0.860s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607dba71-ab74-44e6-8740-1829fd9ef516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625e8791-c7a2-495b-91e3-08a1c43b8710', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a6f12d-aea3-44f8-b55b-909fac6873bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:33:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Volume volume-625e8791-c7a2-495b-91e3-08a1c43b8710 (625e8791-c7a2-495b-91e3-08a1c43b8710): created successfully
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a6f12d-aea3-44f8-b55b-909fac6873bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:33:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (05c50107-e199-4df0-a6e7-c8606def0070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:33:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2ff5822f-c67e-40c3-b846-faa90194335f tempest-AttachVolumeTestJSON-1889353157 None] Created volume successfully.
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "cinder-f53ca2f4-42f8-4df9-b268-35d158b2d0c9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "cinder-f53ca2f4-42f8-4df9-b268-35d158b2d0c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "cinder-quobyte-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "cinder-quobyte-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dda949b-cda7-42e5-884e-d5ac5b97a87f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:33:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:34 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9
Jul 07 03:33:34 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba4d0da-10b3-4b5c-a109-70e1c922880d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:34 devstack sudo[88569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710
Jul 07 03:33:34 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:34 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" returned: 0 in 0.874s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:34 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9
Jul 07 03:33:34 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:35 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710" returned: 0 in 0.969s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.985s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-625e8791-c7a2-495b-91e3-08a1c43b8710', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53eecc88-676e-4db3-92c2-edbf14ad25d7', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:33:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-27e60ae1-e195-425a-98aa-30a35d657899 req-90ebdac6-fad1-4c2c-84df-4030f8e010d6 tempest-AttachVolumeTestJSON-1889353157 None] attachment_update completed successfully.
Jul 07 03:33:35 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" returned: 0 in 1.016s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "cinder-quobyte-f53ca2f4-42f8-4df9-b268-35d158b2d0c9" released by "delete_volume" :: held 1.935s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Created reservations ['0dc29ae9-1cbc-49d5-9866-712bc18ee49a', '49d9de99-7737-43ae-b99f-8341e136dfaa', '3db1b097-b3ac-4ce7-b8cb-4fabda9b09dd', 'da6a4489-d0c4-4668-83a3-9b63758a0111'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:33:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:33:36 devstack sudo[88578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:33:36 devstack sudo[88578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:33:36 devstack sudo[88578]: pam_unix(sudo:session): session closed for user root
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.896s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:33:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Deleted volume successfully.
Jul 07 03:33:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ca44c10-8320-4c2c-b198-712aec76d27e tempest-DeleteServersTestJSON-720978850 None] Lock "cinder-f53ca2f4-42f8-4df9-b268-35d158b2d0c9-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:33:45 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=28,cinder:SELECT=28,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:33:46 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:33:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:33:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Flow 'volume_create_manager' (c741541d-70b5-4856-836d-456040c7cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bfb86f-6271-41cd-a775-d7858b72c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bfb86f-6271-41cd-a775-d7858b72c185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1408288226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555dcac1-11b0-432b-9b26-07bc0d86a039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15be2a1eaeba4da69c8886d145b23b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:13Z,use_quota=True,user_id='399abcd3f809411ea2d4e6e098504d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e41bb7b-5528-4342-a262-6b74c3e5c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e41bb7b-5528-4342-a262-6b74c3e5c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b267344-6e44-4a1e-a0df-78f907ccc948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b267344-6e44-4a1e-a0df-78f907ccc948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555dcac1-11b0-432b-9b26-07bc0d86a039', 'volume_name': 'volume-555dcac1-11b0-432b-9b26-07bc0d86a039', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a715a5b-8660-45bf-abfb-4c3aad57f7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a715a5b-8660-45bf-abfb-4c3aad57f7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd001bab-26e6-4978-a69b-a72c12f51f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Volume 555dcac1-11b0-432b-9b26-07bc0d86a039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555dcac1-11b0-432b-9b26-07bc0d86a039', 'volume_size': 1}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1408288226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555dcac1-11b0-432b-9b26-07bc0d86a039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15be2a1eaeba4da69c8886d145b23b99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:13Z,use_quota=True,user_id='399abcd3f809411ea2d4e6e098504d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Creating volume 555dcac1-11b0-432b-9b26-07bc0d86a039 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:34:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:34:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:12 devstack sudo[89639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 1073741824
Jul 07 03:34:12 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:14 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 1073741824" returned: 0 in 1.477s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:14 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039
Jul 07 03:34:14 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:15 devstack sudo[89664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:34:15 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:15 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039" returned: 0 in 1.020s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.569s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd001bab-26e6-4978-a69b-a72c12f51f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555dcac1-11b0-432b-9b26-07bc0d86a039', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dc8e3f-4c9b-4d07-9d29-6d937a6a3b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Volume volume-555dcac1-11b0-432b-9b26-07bc0d86a039 (555dcac1-11b0-432b-9b26-07bc0d86a039): created successfully
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40dc8e3f-4c9b-4d07-9d29-6d937a6a3b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Flow 'volume_create_manager' (c741541d-70b5-4856-836d-456040c7cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6af095c2-2547-4c78-9df7-dd32a062eab3 tempest-AttachVolumeShelveTestJSON-107306315 None] Created volume successfully.
Jul 07 03:34:16 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.810s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:34:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:34:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:34:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Flow 'volume_create_manager' (9b97e816-5c13-4ec2-aacb-1f33349010de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495fee87-4b6c-42fd-a408-4e20d5e656f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495fee87-4b6c-42fd-a408-4e20d5e656f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1199759114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7564031e-4383-447b-b906-f315f7e3e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c9c083d35d4fea80a06cfee23bbee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:19Z,use_quota=True,user_id='7f725464401449708d2c331e3fb6da1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0a11b-2d86-4646-a7c2-d9d5631cd485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f0a11b-2d86-4646-a7c2-d9d5631cd485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58952ae0-ea11-4aa9-bd1b-7df7c1bdd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58952ae0-ea11-4aa9-bd1b-7df7c1bdd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7564031e-4383-447b-b906-f315f7e3e882', 'volume_name': 'volume-7564031e-4383-447b-b906-f315f7e3e882', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cba2da-c730-4b4e-a571-ae2ad5647b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cba2da-c730-4b4e-a571-ae2ad5647b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e828242-a560-4b7b-b6c1-e26ae688e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Volume 7564031e-4383-447b-b906-f315f7e3e882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7564031e-4383-447b-b906-f315f7e3e882', 'volume_size': 1}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1199759114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7564031e-4383-447b-b906-f315f7e3e882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c9c083d35d4fea80a06cfee23bbee9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:19Z,use_quota=True,user_id='7f725464401449708d2c331e3fb6da1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Creating volume 7564031e-4383-447b-b906-f315f7e3e882 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:34:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:34:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:19 devstack sudo[89715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 1073741824
Jul 07 03:34:19 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:20 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 1073741824" returned: 0 in 1.218s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:20 devstack sudo[89762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882
Jul 07 03:34:20 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:21 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882" returned: 0 in 0.824s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e828242-a560-4b7b-b6c1-e26ae688e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7564031e-4383-447b-b906-f315f7e3e882', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda04f9-4cf8-4a44-b892-1bd2c546436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:21 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Volume volume-7564031e-4383-447b-b906-f315f7e3e882 (7564031e-4383-447b-b906-f315f7e3e882): created successfully
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fda04f9-4cf8-4a44-b892-1bd2c546436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Flow 'volume_create_manager' (9b97e816-5c13-4ec2-aacb-1f33349010de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-66240fa0-dda1-4089-a42d-54471ffae64b tempest-TaggedAttachmentsTest-1074262661 None] Created volume successfully.
Jul 07 03:34:31 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:34:31 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:34:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-b33b5b5a-7750-495f-b408-34f663edf692 req-e291a179-ebf8-4bef-948d-f79d757bb765 tempest-AttachVolumeTestJSON-1889353157 None] Terminate volume connection completed successfully.
Jul 07 03:34:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-b33b5b5a-7750-495f-b408-34f663edf692 req-e291a179-ebf8-4bef-948d-f79d757bb765 tempest-AttachVolumeTestJSON-1889353157 None] Deleting attachment 53eecc88-676e-4db3-92c2-edbf14ad25d7. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:34:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-e05413f0-e987-47c6-b5bf-c3027427491e req-adb07639-b1e3-4116-a8be-ae6fafa74678 tempest-AttachVolumeShelveTestJSON-107306315 None] No connector for attachment 2c6efc53-7a0f-425f-858f-4f164934cc18; skipping storage backend terminate_connection call. {{(pid=86955) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 07 03:34:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-e05413f0-e987-47c6-b5bf-c3027427491e req-adb07639-b1e3-4116-a8be-ae6fafa74678 tempest-AttachVolumeShelveTestJSON-107306315 None] Deleting attachment 2c6efc53-7a0f-425f-858f-4f164934cc18. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:34:43 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:34:43 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Flow 'volume_create_manager' (d7636890-1e49-423a-b8f0-014f6fabcaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd89fbea-8e9e-426e-a5b6-f985470cce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd89fbea-8e9e-426e-a5b6-f985470cce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-237449790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aa6c43-5021-4e46-888e-c28d9abf8bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2f64a84874bb0bcd10e9801cf1d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:47Z,use_quota=True,user_id='efb9f968dd2f4a0aa99dff12222ea4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b421f1-f4c4-479f-adbd-c8aa478b84ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b421f1-f4c4-479f-adbd-c8aa478b84ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88647b2b-1b59-4e37-b1cd-d3046fdbebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88647b2b-1b59-4e37-b1cd-d3046fdbebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19aa6c43-5021-4e46-888e-c28d9abf8bab', 'volume_name': 'volume-19aa6c43-5021-4e46-888e-c28d9abf8bab', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78d0dd-74e3-447d-9047-b5e802a113cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d78d0dd-74e3-447d-9047-b5e802a113cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f94782-3da6-46a0-98f2-49dd188f3669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Volume 19aa6c43-5021-4e46-888e-c28d9abf8bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19aa6c43-5021-4e46-888e-c28d9abf8bab', 'volume_size': 1}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-237449790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aa6c43-5021-4e46-888e-c28d9abf8bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2f64a84874bb0bcd10e9801cf1d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:34:47Z,use_quota=True,user_id='efb9f968dd2f4a0aa99dff12222ea4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Creating volume 19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:34:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:34:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:47 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab 1073741824
Jul 07 03:34:47 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:49 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab 1073741824" returned: 0 in 2.048s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:34:49 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab
Jul 07 03:34:49 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:34:51 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab" returned: 0 in 1.683s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] <== create_volume: return (3898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.906s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f94782-3da6-46a0-98f2-49dd188f3669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19aa6c43-5021-4e46-888e-c28d9abf8bab', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e189ba2-9af5-4176-8c73-aa89f0b56277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:34:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Volume volume-19aa6c43-5021-4e46-888e-c28d9abf8bab (19aa6c43-5021-4e46-888e-c28d9abf8bab): created successfully
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e189ba2-9af5-4176-8c73-aa89f0b56277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:34:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Flow 'volume_create_manager' (d7636890-1e49-423a-b8f0-014f6fabcaff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:34:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-25034a08-8481-496c-bc8b-3638ba400aed tempest-ServerActionsTestOtherA-2018017993 None] Created volume successfully.
Jul 07 03:35:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:35:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:15 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:35:15 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:16 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.257s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:35:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd032b1c-bae1-427a-915a-28ac1492d596]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:35:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:22 devstack sudo[90466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882
Jul 07 03:35:22 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:23 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882" returned: 0 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-7564031e-4383-447b-b906-f315f7e3e882', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61dedf0d-da5d-406e-a34b-a327289b2026', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:35:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-12f4319a-2e3e-4a50-a69b-c74654f0ebdb req-9fb082dc-fbb7-40af-b05e-48aed78f64da tempest-TaggedAttachmentsTest-1074262661 None] attachment_update completed successfully.
Jul 07 03:35:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-a9051790-e6f0-47ef-a4a3-8eab859614a5 req-b58fd001-5251-4b60-af15-b5c35ab08c72 tempest-TaggedAttachmentsTest-1074262661 None] Terminate volume connection completed successfully.
Jul 07 03:35:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-a9051790-e6f0-47ef-a4a3-8eab859614a5 req-b58fd001-5251-4b60-af15-b5c35ab08c72 tempest-TaggedAttachmentsTest-1074262661 None] Deleting attachment 61dedf0d-da5d-406e-a34b-a327289b2026. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:35:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[29286e43-23ba-41bb-8972-fccf08ecffe3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:35:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:35 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab
Jul 07 03:35:35 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:35 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab" returned: 0 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-19aa6c43-5021-4e46-888e-c28d9abf8bab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dfc4850-b3f4-4c25-a013-c60909c8592d', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:35:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-cc90c98c-715a-4f02-81cf-94137aa3f194 req-d3553d1f-d9ca-42ce-b1ae-fc34f7c5c5f7 tempest-ServerActionsTestOtherA-2018017993 None] attachment_update completed successfully.
Jul 07 03:35:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-8aa6478f-65c2-4d25-8fc5-32881be00c0c tempest-ServerActionsTestOtherA-2018017993 None] Terminate volume connection completed successfully.
Jul 07 03:35:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-8aa6478f-65c2-4d25-8fc5-32881be00c0c tempest-ServerActionsTestOtherA-2018017993 None] Deleting attachment 4dfc4850-b3f4-4c25-a013-c60909c8592d. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Acquiring lock "cinder-555dcac1-11b0-432b-9b26-07bc0d86a039-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "cinder-555dcac1-11b0-432b-9b26-07bc0d86a039-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Acquiring lock "cinder-quobyte-555dcac1-11b0-432b-9b26-07bc0d86a039" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "cinder-quobyte-555dcac1-11b0-432b-9b26-07bc0d86a039" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85031db-a050-4e08-819d-a8ac1834c811]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:35:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:45 devstack sudo[91543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039
Jul 07 03:35:45 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:47 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039" returned: 0 in 1.334s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:47 devstack sudo[91568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039
Jul 07 03:35:47 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0a102-c2c3-4565-b81b-43982345309b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:35:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:47 devstack sudo[91579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab
Jul 07 03:35:47 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:48 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-555dcac1-11b0-432b-9b26-07bc0d86a039" returned: 0 in 1.036s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "cinder-quobyte-555dcac1-11b0-432b-9b26-07bc0d86a039" released by "delete_volume" :: held 2.471s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Created reservations ['7dde7cb4-495b-4a71-a693-83ff8a5d9677', '2bb28bab-6e59-45b3-94dc-bb8da739d578', '90d4948e-5010-4eff-b9fe-9a758d351629', '1b037a1a-bda7-410f-9e66-42f774ba1e80'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:48 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:35:48 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "cinder-7564031e-4383-447b-b906-f315f7e3e882-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "cinder-7564031e-4383-447b-b906-f315f7e3e882-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "cinder-quobyte-7564031e-4383-447b-b906-f315f7e3e882" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "cinder-quobyte-7564031e-4383-447b-b906-f315f7e3e882" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a237eb35-951a-48f1-bf35-8e43464d0e80]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:35:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:49 devstack sudo[91623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882
Jul 07 03:35:49 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:49 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab" returned: 0 in 1.306s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.344s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-19aa6c43-5021-4e46-888e-c28d9abf8bab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e5486d9-4018-46f6-8fa6-905f859664da', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:35:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-376147f3-d43d-47bb-9f9c-0d3e16dd1626 req-340b3cf7-9eec-4533-9842-e8860eb59f82 tempest-ServerActionsTestOtherA-2018017993 None] attachment_update completed successfully.
Jul 07 03:35:49 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:35:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Deleted volume successfully.
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1a39664-1fe0-4681-bc23-4a28d6a675ae tempest-AttachVolumeShelveTestJSON-107306315 None] Lock "cinder-555dcac1-11b0-432b-9b26-07bc0d86a039-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:35:49 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882" returned: 0 in 0.908s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:49 devstack sudo[91630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882
Jul 07 03:35:49 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:50 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7564031e-4383-447b-b906-f315f7e3e882" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "cinder-quobyte-7564031e-4383-447b-b906-f315f7e3e882" released by "delete_volume" :: held 1.674s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Created reservations ['254fc20d-b38e-4e1d-bc4a-dab9ce773c8a', 'cd851a2b-4956-452d-97da-f38fe1db9be8', 'cf9e8725-932c-46d1-87a4-20f297d1d062', '0dfd3d9d-cd2d-4833-86f5-ffaaa171d4df'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:50 devstack sudo[91634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:35:50 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:35:51 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root
Jul 07 03:35:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:35:51 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:35:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Deleted volume successfully.
Jul 07 03:35:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1886c5b-61e8-4960-9a53-29cd0542f6ee tempest-TaggedAttachmentsTest-1074262661 None] Lock "cinder-7564031e-4383-447b-b906-f315f7e3e882-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:35:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e0123e2-822f-4d9d-bebd-d5fc3f2fb723 tempest-GroupSnapshotsV319Test-753033722 None] Group tempest-GroupSnapshotsV319Test-Group-535299591: creating
Jul 07 03:35:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e0123e2-822f-4d9d-bebd-d5fc3f2fb723 tempest-GroupSnapshotsV319Test-753033722 None] Group tempest-GroupSnapshotsV319Test-Group-535299591: created successfully
Jul 07 03:35:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e0123e2-822f-4d9d-bebd-d5fc3f2fb723 tempest-GroupSnapshotsV319Test-753033722 None] Create group completed successfully.
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Flow 'volume_create_manager' (78f22b77-190b-439f-9d9b-48637044254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3bb2c9-e737-4544-b2bb-eb98b8ef9f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3bb2c9-e737-4544-b2bb-eb98b8ef9f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317927499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=133f9c84-635e-4433-9fb1-8021769c796e,host='devstack@QuobyteHD#QuobyteHD',id=eb214c48-5f46-42ec-8685-6f356ebcdb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de12d7b709884aae93bdbc870f3afc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:00Z,use_quota=True,user_id='4866efff39154cfabc90f5b9d967f2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6871907-d683-4b16-8749-2b8eddf3b92b),volume_type_id=c6871907-d683-4b16-8749-2b8eddf3b92b)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf90a11-9cc0-42a1-b597-1c0ad99de112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbf90a11-9cc0-42a1-b597-1c0ad99de112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a89944-debe-4862-bcca-532e9ee1b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a89944-debe-4862-bcca-532e9ee1b707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb214c48-5f46-42ec-8685-6f356ebcdb1f', 'volume_name': 'volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d759911f-00bb-4f17-8bb1-9d77b5de8af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d759911f-00bb-4f17-8bb1-9d77b5de8af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3ad655-e926-4976-b3c8-8a8da7318623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:35:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Volume eb214c48-5f46-42ec-8685-6f356ebcdb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f', 'volume_size': 1}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=133f9c84-635e-4433-9fb1-8021769c796e,created_at=2026-07-07T01:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1317927499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=133f9c84-635e-4433-9fb1-8021769c796e,host='devstack@QuobyteHD#QuobyteHD',id=eb214c48-5f46-42ec-8685-6f356ebcdb1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de12d7b709884aae93bdbc870f3afc53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:00Z,use_quota=True,user_id='4866efff39154cfabc90f5b9d967f2bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6871907-d683-4b16-8749-2b8eddf3b92b),volume_type_id=c6871907-d683-4b16-8749-2b8eddf3b92b)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Creating volume eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:35:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:35:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:35:59 devstack sudo[92108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f 1073741824
Jul 07 03:35:59 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:00 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f 1073741824" returned: 0 in 0.941s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:00 devstack sudo[92118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f
Jul 07 03:36:00 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:01 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f" returned: 0 in 0.839s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3ad655-e926-4976-b3c8-8a8da7318623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4934374e-1d31-4a88-840b-258084a78742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Volume volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f (eb214c48-5f46-42ec-8685-6f356ebcdb1f): created successfully
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4934374e-1d31-4a88-840b-258084a78742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Flow 'volume_create_manager' (78f22b77-190b-439f-9d9b-48637044254b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-594217a5-ca97-459a-b323-f1138cd3fd86 tempest-GroupSnapshotsV319Test-753033722 None] Created volume successfully.
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (34c07cf9-4413-4b12-a401-a68a4fd11ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7d2281-8686-4c17-86e1-e9f3bd7bc74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a7d2281-8686-4c17-86e1-e9f3bd7bc74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1607820857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80102375-710f-4fef-b6e1-07c01bec0683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:02Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b2315-3d9e-4c2f-a4a5-4e47e123fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62b2315-3d9e-4c2f-a4a5-4e47e123fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ccbd90-da5b-4202-95fa-dee2922713c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ccbd90-da5b-4202-95fa-dee2922713c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80102375-710f-4fef-b6e1-07c01bec0683', 'volume_name': 'volume-80102375-710f-4fef-b6e1-07c01bec0683', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ee9570-2362-4984-93e9-4997c3160a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ee9570-2362-4984-93e9-4997c3160a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040fba17-a079-4bf8-869d-e60a912450bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Volume 80102375-710f-4fef-b6e1-07c01bec0683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80102375-710f-4fef-b6e1-07c01bec0683', 'volume_size': 1}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1607820857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80102375-710f-4fef-b6e1-07c01bec0683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:02Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Creating volume 80102375-710f-4fef-b6e1-07c01bec0683 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:01 devstack sudo[92122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 1073741824
Jul 07 03:36:01 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] GroupSnapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: creating.
Jul 07 03:36:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Group snapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 03:36:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:03 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 1073741824" returned: 0 in 1.133s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:03 devstack sudo[92128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683
Jul 07 03:36:03 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:03 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.054s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Creating offline snapshot dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba of volume eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040fba17-a079-4bf8-869d-e60a912450bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80102375-710f-4fef-b6e1-07c01bec0683', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad68928-81bc-4d68-b16b-df982af46c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d8e32-90fb-4efe-92c7-a87665654718]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Volume volume-80102375-710f-4fef-b6e1-07c01bec0683 (80102375-710f-4fef-b6e1-07c01bec0683): created successfully
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad68928-81bc-4d68-b16b-df982af46c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (34c07cf9-4413-4b12-a401-a68a4fd11ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f77a985a-743b-4ef3-ad77-be9d4a01337c tempest-AttachVolumeTestJSON-1889353157 None] Created volume successfully.
Jul 07 03:36:04 devstack sudo[92131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f
Jul 07 03:36:04 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:04 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:04 devstack sudo[92137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba 1G
Jul 07 03:36:04 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:05 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba 1G" returned: 0 in 1.038s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:05 devstack sudo[92146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba
Jul 07 03:36:05 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:06 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" returned: 0 in 0.836s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:36:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:06 devstack sudo[92153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba
Jul 07 03:36:06 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:07 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" returned: 0 in 0.777s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:07 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info
Jul 07 03:36:07 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:08 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:08 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:36:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:08 devstack sudo[92167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info
Jul 07 03:36:08 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:09 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.info" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.246s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.733s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f912af69-c931-4fa7-8541-c227cfdd7b2a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9bd3c6e0-449b-4c98-a8df-26de2c67e3f2 tempest-GroupSnapshotsV319Test-753033722 None] group_snapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: created successfully
Jul 07 03:36:09 devstack sudo[92193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683
Jul 07 03:36:09 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:10 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683" returned: 0 in 0.961s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-80102375-710f-4fef-b6e1-07c01bec0683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '856a1fcb-c449-46a5-ae48-3af26f3226c5', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:36:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-258f30fb-0220-4599-a95a-dc47c9919d38 req-f99abe6d-4f2a-4d87-8920-45a1fbfeb27a tempest-AttachVolumeTestJSON-1889353157 None] attachment_update completed successfully.
Jul 07 03:36:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] group_snapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: deleting
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] group_snapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "cinder-quobyte-dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Deleting offline snapshot dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba of volume eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] snapshot_file for this snap is: volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20f12a2-d6d9-440f-b89b-73bcba9b92fa]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:11 devstack sudo[92201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba
Jul 07 03:36:11 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:11 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" returned: 0 in 0.904s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:36:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce5ff12-72c6-4d04-85cf-cba5571b1dbb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:11 devstack sudo[92208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f
Jul 07 03:36:11 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:12 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:12 devstack sudo[92213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba
Jul 07 03:36:12 devstack sudo[92213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:13 devstack sudo[92213]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:13 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba
Jul 07 03:36:13 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:14 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f.dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-dcd59aa7-41be-45b0-b1c7-e75ec5f7f7ba" released by "_delete_snapshot" :: held 3.263s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" released by "delete_snapshot" :: held 3.289s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:14 devstack cinder-volume[86955]: WARNING cinder.quota [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2135135024 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2135135024, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:14 devstack cinder-volume[86955]: WARNING cinder.quota [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2135135024 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2135135024, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:14 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] Created reservations ['dbcf2e5a-4f48-40fa-8a3b-78934641562e', '9f2530c3-57c0-4ac6-9766-371bba32115c', '90b1f7ef-e35f-4061-91c7-a4f8b83521e5', '8eab3c9e-8844-45c4-a9ec-0db7878b6c66'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-11002102-eb2c-4038-b254-942f09921b0e tempest-GroupSnapshotsV319Test-753033722 None] group_snapshot 4f3c9e64-cabf-40aa-b70c-332d7f6957b0: deleted successfully
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (274ee09d-b80c-4d89-ae8e-1ac24d9b36c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9c27fe-334d-402e-ab06-58c275198927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9c27fe-334d-402e-ab06-58c275198927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-375728134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea39d61-9c92-4c31-96b4-dd9b09a7de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:15Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfad5b4-3a13-4149-b67b-b05b1c5a994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfad5b4-3a13-4149-b67b-b05b1c5a994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716fb70f-233f-4f66-a9fe-5fca027e764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716fb70f-233f-4f66-a9fe-5fca027e764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea39d61-9c92-4c31-96b4-dd9b09a7de62', 'volume_name': 'volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3f7d45-b1ff-437b-83ac-cb358fd9dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3f7d45-b1ff-437b-83ac-cb358fd9dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc16732-aa29-4d7d-8a3e-8f63cdd94fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Volume 3ea39d61-9c92-4c31-96b4-dd9b09a7de62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62', 'volume_size': 1}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-375728134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea39d61-9c92-4c31-96b4-dd9b09a7de62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d8281641bd43e686450b54a900b46e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:15Z,use_quota=True,user_id='63afbad3c42f4b5c9430f755ad2bf1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Creating volume 3ea39d61-9c92-4c31-96b4-dd9b09a7de62 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:15 devstack sudo[92250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 1073741824
Jul 07 03:36:15 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:15 devstack sudo[92251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:15 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66cb08-2904-4351-b758-67917f139dab]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:15 devstack sudo[92256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f
Jul 07 03:36:15 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:16 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.982s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:36:16 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 1073741824" returned: 0 in 1.191s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:16 devstack sudo[92266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62
Jul 07 03:36:16 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:16 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f" returned: 0 in 0.971s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:16 devstack sudo[92273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f
Jul 07 03:36:16 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:17 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" returned: 0 in 0.826s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc16732-aa29-4d7d-8a3e-8f63cdd94fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f878ea6-2a4a-41ea-b892-2d89f1764904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Volume volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 (3ea39d61-9c92-4c31-96b4-dd9b09a7de62): created successfully
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f878ea6-2a4a-41ea-b892-2d89f1764904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Flow 'volume_create_manager' (274ee09d-b80c-4d89-ae8e-1ac24d9b36c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1daca42c-7c26-4576-a062-ce6d1054a592 tempest-AttachVolumeTestJSON-1889353157 None] Created volume successfully.
Jul 07 03:36:17 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb214c48-5f46-42ec-8685-6f356ebcdb1f" returned: 0 in 0.803s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Lock "cinder-quobyte-eb214c48-5f46-42ec-8685-6f356ebcdb1f" released by "delete_volume" :: held 1.876s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Created reservations ['eaa14bb3-7d1c-4594-947a-780640a668bd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:17 devstack cinder-volume[86955]: WARNING cinder.quota [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2135135024 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2135135024, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Created reservations ['d467be52-9e9b-442a-88b7-7c63b90567c3', '10d78254-aed6-4a66-a293-0b0ad5d3bceb', 'b351689d-660d-4a36-8e91-7c072012ece8', '83afb535-4287-46f1-a51a-61ff3d257fa8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:17 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:17 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:18 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:18 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0eaf281e-4146-42f3-8249-1ac638d4aa71 tempest-GroupSnapshotsV319Test-753033722 None] Delete group completed successfully.
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=61,cinder:UPDATE=56,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=67,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1e0f90-1f4a-40e5-be8b-e847f4ba386e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:21 devstack sudo[92299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62
Jul 07 03:36:21 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:22 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" returned: 0 in 1.289s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.326s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42cdb662-fb9b-4440-9240-2a3c60bfa1f0', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:36:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-26e95c38-b50d-4a95-bff2-427b689b7689 req-f408466f-9359-4f7f-9897-b355172115ab tempest-AttachVolumeTestJSON-1889353157 None] attachment_update completed successfully.
Jul 07 03:36:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-5dc48842-14f9-443d-ab82-89bbcd21421d req-f197498d-4df6-40a0-82d9-b8c74ceef05d tempest-ServerActionsTestOtherA-2018017993 None] Terminate volume connection completed successfully.
Jul 07 03:36:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-5dc48842-14f9-443d-ab82-89bbcd21421d req-f197498d-4df6-40a0-82d9-b8c74ceef05d tempest-ServerActionsTestOtherA-2018017993 None] Deleting attachment 7e5486d9-4018-46f6-8fa6-905f859664da. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:36:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-14b8899f-cdb3-4840-b9a6-12e480dbd57f tempest-GroupsTest-832081529 None] Group tempest-Group1-1366092358: creating
Jul 07 03:36:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-14b8899f-cdb3-4840-b9a6-12e480dbd57f tempest-GroupsTest-832081529 None] Group tempest-Group1-1366092358: created successfully
Jul 07 03:36:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-14b8899f-cdb3-4840-b9a6-12e480dbd57f tempest-GroupsTest-832081529 None] Create group completed successfully.
Jul 07 03:36:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16d0655a-2d9c-4251-a661-a70887e45c00 tempest-GroupsTest-832081529 None] Group tempest-Group2-338561748: creating
Jul 07 03:36:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16d0655a-2d9c-4251-a661-a70887e45c00 tempest-GroupsTest-832081529 None] Group tempest-Group2-338561748: created successfully
Jul 07 03:36:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16d0655a-2d9c-4251-a661-a70887e45c00 tempest-GroupsTest-832081529 None] Create group completed successfully.
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (e4ee4519-b55e-49c8-ae74-92bfda05ea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2fb108-b45c-440b-94b4-4b8af3165657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2fb108-b45c-440b-94b4-4b8af3165657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945943266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=40a42ced-0cb0-4b90-b391-048dd048be89,host='devstack@QuobyteHD#QuobyteHD',id=319b2239-975d-4fd3-a143-b95f8b10f727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:29Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76651bf5-1a84-4ffc-8e9e-c2bc091ae293),volume_type_id=76651bf5-1a84-4ffc-8e9e-c2bc091ae293)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a36c64b-6df2-4c2d-9278-088be43e307b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a36c64b-6df2-4c2d-9278-088be43e307b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bbb40f-5f70-4123-8e45-31b77a95b22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bbb40f-5f70-4123-8e45-31b77a95b22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319b2239-975d-4fd3-a143-b95f8b10f727', 'volume_name': 'volume-319b2239-975d-4fd3-a143-b95f8b10f727', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b3a6d-5f0e-432d-b3a0-98b0324bf79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10b3a6d-5f0e-432d-b3a0-98b0324bf79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb65843-4e92-4e8b-9dc5-370f79b621c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Volume 319b2239-975d-4fd3-a143-b95f8b10f727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319b2239-975d-4fd3-a143-b95f8b10f727', 'volume_size': 1}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=40a42ced-0cb0-4b90-b391-048dd048be89,created_at=2026-07-07T01:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1945943266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=40a42ced-0cb0-4b90-b391-048dd048be89,host='devstack@QuobyteHD#QuobyteHD',id=319b2239-975d-4fd3-a143-b95f8b10f727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:29Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76651bf5-1a84-4ffc-8e9e-c2bc091ae293),volume_type_id=76651bf5-1a84-4ffc-8e9e-c2bc091ae293)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Creating volume 319b2239-975d-4fd3-a143-b95f8b10f727 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:28 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:29 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 1073741824
Jul 07 03:36:29 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:30 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 1073741824" returned: 0 in 1.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:30 devstack sudo[92497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727
Jul 07 03:36:30 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:32 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727" returned: 0 in 1.204s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] <== create_volume: return (3168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.175s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb65843-4e92-4e8b-9dc5-370f79b621c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319b2239-975d-4fd3-a143-b95f8b10f727', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e48baf9-2731-48d7-b5f1-5055072248d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Volume volume-319b2239-975d-4fd3-a143-b95f8b10f727 (319b2239-975d-4fd3-a143-b95f8b10f727): created successfully
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e48baf9-2731-48d7-b5f1-5055072248d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (e4ee4519-b55e-49c8-ae74-92bfda05ea4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f0796d8b-2b35-4f9d-a396-ebb6fec45cc7 req-538ee73c-9535-4ae6-899a-f2f59d8052ab tempest-AttachVolumeTestJSON-1889353157 None] Terminate volume connection completed successfully.
Jul 07 03:36:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f0796d8b-2b35-4f9d-a396-ebb6fec45cc7 req-538ee73c-9535-4ae6-899a-f2f59d8052ab tempest-AttachVolumeTestJSON-1889353157 None] Deleting attachment 856a1fcb-c449-46a5-ae48-3af26f3226c5. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:36:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-20b44f6b-bd20-49a8-b15f-8e71775ec4a1 tempest-GroupsTest-832081529 None] Created volume successfully.
Jul 07 03:36:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Acquiring lock "cinder-quobyte-319b2239-975d-4fd3-a143-b95f8b10f727" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-319b2239-975d-4fd3-a143-b95f8b10f727" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6af32e-64bc-4891-8efc-4bab01c7c8b7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:34 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727
Jul 07 03:36:34 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:35 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727" returned: 0 in 1.229s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:35 devstack sudo[92548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727
Jul 07 03:36:35 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-4d059278-77f7-430b-a1f8-9a0d3f161166 req-8425fca3-ca61-495f-8278-42e479bca774 tempest-AttachVolumeTestJSON-1889353157 None] Terminate volume connection completed successfully.
Jul 07 03:36:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-4d059278-77f7-430b-a1f8-9a0d3f161166 req-8425fca3-ca61-495f-8278-42e479bca774 tempest-AttachVolumeTestJSON-1889353157 None] Deleting attachment 42cdb662-fb9b-4440-9240-2a3c60bfa1f0. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:36:36 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-319b2239-975d-4fd3-a143-b95f8b10f727" returned: 0 in 1.326s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-319b2239-975d-4fd3-a143-b95f8b10f727" released by "delete_volume" :: held 2.639s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Created reservations ['19e24fcc-e9dd-4dbd-87b2-9c8a5cd9f6a1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:36 devstack cinder-volume[86955]: WARNING cinder.quota [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-15896258 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-15896258, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:36 devstack cinder-volume[86955]: WARNING cinder.quota [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-15896258 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-15896258, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Created reservations ['e790d09d-fa74-4fab-a0b0-f1396b7e878d', '6206cfc8-cc6d-4b79-a79a-984206932db2', 'dd9530da-1593-44a1-8f72-73d55b7dec29', 'e9de6d6f-c6ce-49a1-b7bb-acff8e9ecffa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:37 devstack sudo[92554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:37 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:37 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.806s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:37 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9b523f36-56fb-479b-b600-621a83a791bf tempest-GroupsTest-832081529 None] Delete group completed successfully.
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Created reservations ['1f08bde7-4234-4509-a38f-100add3c1e19'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:38 devstack sudo[92558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:38 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "cinder-19aa6c43-5021-4e46-888e-c28d9abf8bab-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "cinder-19aa6c43-5021-4e46-888e-c28d9abf8bab-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "cinder-quobyte-19aa6c43-5021-4e46-888e-c28d9abf8bab" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "cinder-quobyte-19aa6c43-5021-4e46-888e-c28d9abf8bab" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b26894-08f0-4dc7-af69-fbef57fc230e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:38 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab
Jul 07 03:36:38 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:39 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4aa21c5e-2240-4003-92ef-4acb0146cc93 tempest-GroupsTest-832081529 None] Delete group completed successfully.
Jul 07 03:36:39 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab" returned: 0 in 1.039s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:39 devstack sudo[92572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab
Jul 07 03:36:39 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3c0ce8a6-5e68-43c3-b226-5dd35bb05799 tempest-GroupsTest-832081529 None] Group tempest-GroupsTest-Group-601168787: creating
Jul 07 03:36:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3c0ce8a6-5e68-43c3-b226-5dd35bb05799 tempest-GroupsTest-832081529 None] Group tempest-GroupsTest-Group-601168787: created successfully
Jul 07 03:36:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3c0ce8a6-5e68-43c3-b226-5dd35bb05799 tempest-GroupsTest-832081529 None] Create group completed successfully.
Jul 07 03:36:40 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19aa6c43-5021-4e46-888e-c28d9abf8bab" returned: 0 in 0.756s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "cinder-quobyte-19aa6c43-5021-4e46-888e-c28d9abf8bab" released by "delete_volume" :: held 1.851s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Created reservations ['faf05e7a-5422-4d53-a691-7e5314cfab74', 'ca2f4670-b1bc-4d4c-b009-3ca4bda73bc9', '9e638d08-7237-49e0-886d-dd9a258ebdc6', '47c10ba8-3939-41e5-b064-d010911e1a0a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:40 devstack sudo[92585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:40 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:41 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.098s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Deleted volume successfully.
Jul 07 03:36:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-86026bad-cf6a-4c9e-a766-cd18b453474c tempest-ServerActionsTestOtherA-2018017993 None] Lock "cinder-19aa6c43-5021-4e46-888e-c28d9abf8bab-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (1a8702c9-2796-4794-ac78-5b6c43e5376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859d776-094d-43a6-a120-fdf722839a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f859d776-094d-43a6-a120-fdf722839a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009365324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,host='devstack@QuobyteHD#QuobyteHD',id=73258ff0-9f48-4fc6-990c-88013a3c46fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:42Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3395d86a-3aac-4974-87ba-64fbf95c3852),volume_type_id=3395d86a-3aac-4974-87ba-64fbf95c3852)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d230bb98-541a-4ad8-af54-35c93c3d868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d230bb98-541a-4ad8-af54-35c93c3d868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c4a5b8-60f3-443f-903d-d3433ad361e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c4a5b8-60f3-443f-903d-d3433ad361e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73258ff0-9f48-4fc6-990c-88013a3c46fc', 'volume_name': 'volume-73258ff0-9f48-4fc6-990c-88013a3c46fc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795e5d83-81d1-4d51-ab9a-f51315b4db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795e5d83-81d1-4d51-ab9a-f51315b4db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9238a5-a487-4b50-8e76-5dd4a6c2d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Volume 73258ff0-9f48-4fc6-990c-88013a3c46fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73258ff0-9f48-4fc6-990c-88013a3c46fc', 'volume_size': 1}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,created_at=2026-07-07T01:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1009365324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,host='devstack@QuobyteHD#QuobyteHD',id=73258ff0-9f48-4fc6-990c-88013a3c46fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:42Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3395d86a-3aac-4974-87ba-64fbf95c3852),volume_type_id=3395d86a-3aac-4974-87ba-64fbf95c3852)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Creating volume 73258ff0-9f48-4fc6-990c-88013a3c46fc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:42 devstack sudo[92613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc 1073741824
Jul 07 03:36:42 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:44 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc 1073741824" returned: 0 in 1.476s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:44 devstack sudo[92665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc
Jul 07 03:36:44 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:45 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc" returned: 0 in 1.048s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] <== create_volume: return (2592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9238a5-a487-4b50-8e76-5dd4a6c2d437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73258ff0-9f48-4fc6-990c-88013a3c46fc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de4e702-6397-4cc9-b6f0-1f485b1ef683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Volume volume-73258ff0-9f48-4fc6-990c-88013a3c46fc (73258ff0-9f48-4fc6-990c-88013a3c46fc): created successfully
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de4e702-6397-4cc9-b6f0-1f485b1ef683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (1a8702c9-2796-4794-ac78-5b6c43e5376e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-239a39c7-f668-4a1b-b365-0805c33b0ece tempest-GroupsTest-832081529 None] Created volume successfully.
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (43883eee-88ec-4f44-b11c-41dc05e1c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2e0a19-51ef-4f5a-b485-780145d08d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2e0a19-51ef-4f5a-b485-780145d08d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1237466069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,host='devstack@QuobyteHD#QuobyteHD',id=f4ed3511-dd8b-476b-8586-c74d6d0268ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:47Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3395d86a-3aac-4974-87ba-64fbf95c3852),volume_type_id=3395d86a-3aac-4974-87ba-64fbf95c3852)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173c57f4-6eb1-40b0-ab7d-ec02a09593e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173c57f4-6eb1-40b0-ab7d-ec02a09593e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73960a7a-b99b-4f10-bf7b-ef138cde8cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73960a7a-b99b-4f10-bf7b-ef138cde8cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4ed3511-dd8b-476b-8586-c74d6d0268ec', 'volume_name': 'volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf1fe2f-211c-4e25-a6cb-0fd51d6e1965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf1fe2f-211c-4e25-a6cb-0fd51d6e1965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e934cde4-ce82-4b02-b85a-eb4e3d7fcc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Volume f4ed3511-dd8b-476b-8586-c74d6d0268ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec', 'volume_size': 1}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,created_at=2026-07-07T01:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1237466069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7320d90f-33ad-4ee1-8e41-5a7f5e60aaff,host='devstack@QuobyteHD#QuobyteHD',id=f4ed3511-dd8b-476b-8586-c74d6d0268ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa92b850881d4bff879a68a5b316b6e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:47Z,use_quota=True,user_id='fece18a9458f446bbd802a551e085194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3395d86a-3aac-4974-87ba-64fbf95c3852),volume_type_id=3395d86a-3aac-4974-87ba-64fbf95c3852)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Creating volume f4ed3511-dd8b-476b-8586-c74d6d0268ec {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:47 devstack sudo[92691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec 1073741824
Jul 07 03:36:47 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Flow 'volume_create_manager' (c40be082-2972-4fd9-a044-9b4939ba71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afba766f-c85b-4ea0-a7ba-3c4cdf42b774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afba766f-c85b-4ea0-a7ba-3c4cdf42b774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1645945155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e411aa-0b0a-44be-818e-c1a92246d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5899574070dc4ac3805d2660d4e72b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:48Z,use_quota=True,user_id='2e913904979e42c2ab739f40bc6322c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7d69ce-9745-4d25-8727-440123748332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7d69ce-9745-4d25-8727-440123748332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f541e25c-832f-4522-8605-efdd1bd0124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f541e25c-832f-4522-8605-efdd1bd0124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e411aa-0b0a-44be-818e-c1a92246d9ea', 'volume_name': 'volume-44e411aa-0b0a-44be-818e-c1a92246d9ea', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ad38c-3b6b-4fec-a48f-56a74c7e0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5ad38c-3b6b-4fec-a48f-56a74c7e0f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf136b2-9a42-4c62-bd09-225336012624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Volume 44e411aa-0b0a-44be-818e-c1a92246d9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e411aa-0b0a-44be-818e-c1a92246d9ea', 'volume_size': 1}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:48 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec 1073741824" returned: 0 in 1.215s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:48 devstack sudo[92709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec
Jul 07 03:36:48 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:49 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1645945155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e411aa-0b0a-44be-818e-c1a92246d9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5899574070dc4ac3805d2660d4e72b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:36:48Z,use_quota=True,user_id='2e913904979e42c2ab739f40bc6322c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Creating volume 44e411aa-0b0a-44be-818e-c1a92246d9ea {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:36:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:49 devstack sudo[92712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea 1073741824
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e934cde4-ce82-4b02-b85a-eb4e3d7fcc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:49 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0da9ac3-ce8d-43fd-921f-fb0e8f28c173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Volume volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec (f4ed3511-dd8b-476b-8586-c74d6d0268ec): created successfully
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0da9ac3-ce8d-43fd-921f-fb0e8f28c173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Flow 'volume_create_manager' (43883eee-88ec-4f44-b11c-41dc05e1c30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-27940bdd-b511-40da-b2ae-b57dff65109d tempest-GroupsTest-832081529 None] Created volume successfully.
Jul 07 03:36:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-70b4db2b-84fc-4fb2-bab9-37367b619a0f tempest-GroupsTest-832081529 None] Update group completed successfully.
Jul 07 03:36:50 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea 1073741824" returned: 0 in 1.400s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:50 devstack sudo[92719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea
Jul 07 03:36:50 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-3ea39d61-9c92-4c31-96b4-dd9b09a7de62-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-3ea39d61-9c92-4c31-96b4-dd9b09a7de62-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-quobyte-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" acquired by "delete_volume" :: waited 0.050s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a71703-e150-4e11-a1cd-962b024eed3e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:51 devstack sudo[92721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62
Jul 07 03:36:51 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:52 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea" returned: 0 in 1.265s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] <== create_volume: return (2722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.727s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf136b2-9a42-4c62-bd09-225336012624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e411aa-0b0a-44be-818e-c1a92246d9ea', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643962d2-5c27-4a0b-b86c-36012ac87504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:36:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-77b1464d-5bb8-4b86-9831-dfe48113be07 tempest-GroupsTest-832081529 None] Update group completed successfully.
Jul 07 03:36:52 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Volume volume-44e411aa-0b0a-44be-818e-c1a92246d9ea (44e411aa-0b0a-44be-818e-c1a92246d9ea): created successfully
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643962d2-5c27-4a0b-b86c-36012ac87504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Flow 'volume_create_manager' (c40be082-2972-4fd9-a044-9b4939ba71ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:36:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bea0b932-111d-4aff-be35-c990370e4000 tempest-ServerRescueNegativeTestJSON-1133973114 None] Created volume successfully.
Jul 07 03:36:52 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" returned: 0 in 1.391s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:52 devstack sudo[92734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62
Jul 07 03:36:52 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:53 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" returned: 0 in 0.977s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-3ea39d61-9c92-4c31-96b4-dd9b09a7de62" released by "delete_volume" :: held 2.471s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Created reservations ['b1d0151e-7418-45b6-a814-803339c4ad7c', '38362f00-35bc-4663-9181-733740a655d6', 'a767006c-41bb-41e7-b0db-ddc133143e52', '4f1baf2c-e9b0-4a07-a598-5ca9bedc7276'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:54 devstack sudo[92737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:54 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Acquiring lock "cinder-quobyte-73258ff0-9f48-4fc6-990c-88013a3c46fc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-73258ff0-9f48-4fc6-990c-88013a3c46fc" acquired by "delete_volume" :: waited 0.046s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2faab3e-6b63-4c05-81e9-d046d7dc91a3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:54 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc
Jul 07 03:36:54 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-80102375-710f-4fef-b6e1-07c01bec0683-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-80102375-710f-4fef-b6e1-07c01bec0683-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-quobyte-80102375-710f-4fef-b6e1-07c01bec0683" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-80102375-710f-4fef-b6e1-07c01bec0683" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d675c-05a7-4bc2-8aae-626340942341]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:55 devstack sudo[92741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683
Jul 07 03:36:55 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:55 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.186s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Deleted volume successfully.
Jul 07 03:36:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4a9867b3-c619-4c5a-bdbb-cf78ef319387 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-3ea39d61-9c92-4c31-96b4-dd9b09a7de62-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:55 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc" returned: 0 in 1.379s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:55 devstack sudo[92748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc
Jul 07 03:36:55 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:56 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683" returned: 0 in 1.263s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:56 devstack sudo[92753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683
Jul 07 03:36:56 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:56 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73258ff0-9f48-4fc6-990c-88013a3c46fc" returned: 0 in 1.084s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-73258ff0-9f48-4fc6-990c-88013a3c46fc" released by "delete_volume" :: held 2.531s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Acquiring lock "cinder-quobyte-f4ed3511-dd8b-476b-8586-c74d6d0268ec" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-f4ed3511-dd8b-476b-8586-c74d6d0268ec" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1dbff-3ba9-4224-b0f0-36a22dde35cb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:57 devstack sudo[92756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec
Jul 07 03:36:57 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:57 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-80102375-710f-4fef-b6e1-07c01bec0683" returned: 0 in 1.438s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-80102375-710f-4fef-b6e1-07c01bec0683" released by "delete_volume" :: held 2.777s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Created reservations ['10e849fd-72f4-4b36-b84d-47d090fb3f99', 'a5b46363-bbb6-4a52-b0e8-511004d97688', 'bea2b618-bdb0-4d30-a4f3-5cd9bdade6aa', '92167788-1c9c-4dfe-a838-3534cc0fa108'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:58 devstack sudo[92768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:58 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:58 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec" returned: 0 in 1.322s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:58 devstack sudo[92771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec
Jul 07 03:36:58 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-625e8791-c7a2-495b-91e3-08a1c43b8710-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-625e8791-c7a2-495b-91e3-08a1c43b8710-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "cinder-quobyte-625e8791-c7a2-495b-91e3-08a1c43b8710" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-625e8791-c7a2-495b-91e3-08a1c43b8710" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7cccdf-77fc-4230-b9ed-866b299376d4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:36:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:59 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f4ed3511-dd8b-476b-8586-c74d6d0268ec" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "cinder-quobyte-f4ed3511-dd8b-476b-8586-c74d6d0268ec" released by "delete_volume" :: held 2.257s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:59 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.175s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:59 devstack sudo[92795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710
Jul 07 03:36:59 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:36:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Deleted volume successfully.
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9fa2b8fa-60fc-4511-9dce-3b27a980c073 tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-80102375-710f-4fef-b6e1-07c01bec0683-delete_volume" released by "delete_volume" :: held 4.404s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Created reservations ['ceac3318-c2f7-4a14-9ed2-1e3bc7656c2c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:59 devstack cinder-volume[86955]: WARNING cinder.quota [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1046639290 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1046639290, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:59 devstack cinder-volume[86955]: WARNING cinder.quota [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1046639290 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1046639290, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Created reservations ['b00e3efe-d41f-407b-bdfe-8e003a06fa61', '0664e553-fb5a-4925-9ed2-12d02b7d21c4', 'dd1a507d-1321-4874-99f5-1d421ed2deac', 'adf83c38-588f-4f69-b02d-e873cff9ee33'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Created reservations ['49319e4f-8e46-442a-b48a-2b3ec8acabb0', '94245380-92bf-405f-8503-22047853f069', 'aefc5311-3aa0-4dcf-8c63-ada8dd137f50', '0701820f-56b3-4e5a-bdcf-f2e4d4ed9373'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:59 devstack sudo[92801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:36:59 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:36:59 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710" returned: 0 in 0.984s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:36:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:36:59 devstack sudo[92807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710
Jul 07 03:37:00 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:00 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.898s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7ea99836-cf87-412e-85f5-09eec647fdd6 tempest-GroupsTest-832081529 None] Delete group completed successfully.
Jul 07 03:37:00 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-625e8791-c7a2-495b-91e3-08a1c43b8710" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-quobyte-625e8791-c7a2-495b-91e3-08a1c43b8710" released by "delete_volume" :: held 1.823s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Created reservations ['d8c0c6f1-af4f-4740-9d93-8ea4c71043a6', '96257156-066b-4e56-981c-29286782b1cc', 'f4638bdc-ee76-42da-ba00-b95c25c48cd2', 'd79ffaf3-faa2-473c-8035-e5ba2c80c452'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:00 devstack sudo[92812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:00 devstack sudo[92812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:01 devstack sudo[92812]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:01 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Deleted volume successfully.
Jul 07 03:37:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1832c674-0afe-4a54-a37e-c1213854ed9a tempest-AttachVolumeTestJSON-1889353157 None] Lock "cinder-625e8791-c7a2-495b-91e3-08a1c43b8710-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15ea0cd4-cb75-4e45-91ae-66946718b27a tempest-GroupsV320Test-706539102 None] Group tempest-GroupsV320Test-Group-2010910895: creating
Jul 07 03:37:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15ea0cd4-cb75-4e45-91ae-66946718b27a tempest-GroupsV320Test-706539102 None] Group tempest-GroupsV320Test-Group-2010910895: created successfully
Jul 07 03:37:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15ea0cd4-cb75-4e45-91ae-66946718b27a tempest-GroupsV320Test-706539102 None] Create group completed successfully.
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Created reservations ['a06943a8-d7db-4585-931b-e2f4d04887a0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:11 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:11 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:12 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d6fb9548-8ac7-44f8-b6c4-aa34cc1ed9e5 tempest-GroupsV320Test-706539102 None] Delete group completed successfully.
Jul 07 03:37:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca0e7c17-b314-4de1-816a-69a8bf271b79 tempest-BackendsCapabilitiesAdminTestsJSON-1838372485 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Acquiring lock "cinder-44e411aa-0b0a-44be-818e-c1a92246d9ea-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "cinder-44e411aa-0b0a-44be-818e-c1a92246d9ea-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Acquiring lock "cinder-quobyte-44e411aa-0b0a-44be-818e-c1a92246d9ea" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "cinder-quobyte-44e411aa-0b0a-44be-818e-c1a92246d9ea" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cae31e1-f4af-4ace-a32b-3855c3716ecd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3a6604f3-5124-4677-9e07-b8eb178dd177 tempest-BackendsCapabilitiesAdminTestsJSON-1838372485 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 03:37:13 devstack sudo[92878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea
Jul 07 03:37:13 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:14 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea" returned: 0 in 1.251s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:14 devstack sudo[92883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea
Jul 07 03:37:14 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:15 devstack sudo[92885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:15 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:15 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-44e411aa-0b0a-44be-818e-c1a92246d9ea" returned: 0 in 1.282s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "cinder-quobyte-44e411aa-0b0a-44be-818e-c1a92246d9ea" released by "delete_volume" :: held 2.609s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Created reservations ['4087dd54-772c-44f2-b36f-4d434cf3e35f', '602cd1a5-523f-491f-9b3d-0a0a9329dd80', '65451973-178a-4a92-9c75-a21cfad42290', '5f2b6c89-9016-460e-97bd-a4146f10131f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:16 devstack sudo[92889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:16 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:16 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.055s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:37:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:37:17 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.140s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Deleted volume successfully.
Jul 07 03:37:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-241534cf-1922-4bbc-b93d-dfc956e8f4c9 tempest-ServerRescueNegativeTestJSON-1133973114 None] Lock "cinder-44e411aa-0b0a-44be-818e-c1a92246d9ea-delete_volume" released by "delete_volume" :: held 4.210s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=73,cinder:UPDATE=96,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:37:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a1d80204-54de-4f1f-85eb-4eacbe3e8df9 tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-171673066: creating
Jul 07 03:37:24 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=93,cinder:UPDATE=91,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:37:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a1d80204-54de-4f1f-85eb-4eacbe3e8df9 tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-171673066: created successfully
Jul 07 03:37:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a1d80204-54de-4f1f-85eb-4eacbe3e8df9 tempest-GroupSnapshotsTest-668071879 None] Create group completed successfully.
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Flow 'volume_create_manager' (fbffbd08-7cd2-4798-b359-a1f6a9be8451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d91b537-1b64-4ce3-ad64-3460730af89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d91b537-1b64-4ce3-ad64-3460730af89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-888276053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fdbbea-2193-4f7b-a8ae-eceedd02a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8620ff51ebec4099bcb587aa040e69b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:25Z,use_quota=True,user_id='fe7a59e4dece4910a3ddf204bbc6fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4786707-b0c1-477a-9db8-85a80bd62ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4786707-b0c1-477a-9db8-85a80bd62ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f8efb-4ea8-4b85-a32d-f80743e43015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd3f8efb-4ea8-4b85-a32d-f80743e43015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fdbbea-2193-4f7b-a8ae-eceedd02a14e', 'volume_name': 'volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0789af-49fe-498d-8068-12a52cada12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0789af-49fe-498d-8068-12a52cada12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ae372f-db3a-47ea-acd0-20958f303a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Volume a2fdbbea-2193-4f7b-a8ae-eceedd02a14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e', 'volume_size': 1}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-888276053',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fdbbea-2193-4f7b-a8ae-eceedd02a14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8620ff51ebec4099bcb587aa040e69b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:25Z,use_quota=True,user_id='fe7a59e4dece4910a3ddf204bbc6fee5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Creating volume a2fdbbea-2193-4f7b-a8ae-eceedd02a14e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:37:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:37:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:25 devstack sudo[92930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e 1073741824
Jul 07 03:37:25 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:26 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e 1073741824" returned: 0 in 0.952s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:26 devstack sudo[92936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e
Jul 07 03:37:26 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (5e78365f-60b4-446b-9091-64b218e225df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea33638-9e16-40f1-a6ba-852a9fac68af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea33638-9e16-40f1-a6ba-852a9fac68af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-194475882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cf504064-b0cf-4962-812b-e514705dd20f,host='devstack@QuobyteHD#QuobyteHD',id=72ff77b1-9906-492f-aaef-05b9c8c6dbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:26Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7757365-7ed3-45f8-9826-1bd534077c63),volume_type_id=b7757365-7ed3-45f8-9826-1bd534077c63)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330bdea9-d51e-4ad6-a46e-b4f5a8e71f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330bdea9-d51e-4ad6-a46e-b4f5a8e71f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0146eef9-6454-4a3b-baf7-5360000a86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0146eef9-6454-4a3b-baf7-5360000a86f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ff77b1-9906-492f-aaef-05b9c8c6dbff', 'volume_name': 'volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50a7aff-98fd-425a-a046-547a1d440861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e50a7aff-98fd-425a-a046-547a1d440861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb641c7e-adf5-43a8-baf9-211baefa9f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Volume 72ff77b1-9906-492f-aaef-05b9c8c6dbff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff', 'volume_size': 1}
Jul 07 03:37:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:26 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.601s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cf504064-b0cf-4962-812b-e514705dd20f,created_at=2026-07-07T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-194475882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cf504064-b0cf-4962-812b-e514705dd20f,host='devstack@QuobyteHD#QuobyteHD',id=72ff77b1-9906-492f-aaef-05b9c8c6dbff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:26Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7757365-7ed3-45f8-9826-1bd534077c63),volume_type_id=b7757365-7ed3-45f8-9826-1bd534077c63)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Creating volume 72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:37:27 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:27 devstack sudo[92944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff 1073741824
Jul 07 03:37:27 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ae372f-db3a-47ea-acd0-20958f303a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc77b82-b52a-4d1a-9ba6-1461fb6c22fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Volume volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e (a2fdbbea-2193-4f7b-a8ae-eceedd02a14e): created successfully
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc77b82-b52a-4d1a-9ba6-1461fb6c22fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Flow 'volume_create_manager' (fbffbd08-7cd2-4798-b359-a1f6a9be8451) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-893103d7-c677-4121-af40-8d33223b6f9c tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Created volume successfully.
Jul 07 03:37:28 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff 1073741824" returned: 0 in 1.092s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:28 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:37:28 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:28 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.950s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb641c7e-adf5-43a8-baf9-211baefa9f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633f128d-d3a1-4bd2-a436-49063f0553d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Volume volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff (72ff77b1-9906-492f-aaef-05b9c8c6dbff): created successfully
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633f128d-d3a1-4bd2-a436-49063f0553d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (5e78365f-60b4-446b-9091-64b218e225df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8ea4c2c3-7a24-462a-8a25-e1792f0b6a14 tempest-GroupSnapshotsTest-668071879 None] Created volume successfully.
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Acquiring lock "cinder-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "cinder-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Acquiring lock "cinder-quobyte-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "cinder-quobyte-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae62e42-fd59-4c2e-9043-8293a4a62af4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:29 devstack sudo[92972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e
Jul 07 03:37:29 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] GroupSnapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: creating.
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Group snapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Creating offline snapshot 6102ccf1-bdd3-486a-8235-03e0e64fcf52 of volume 72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff54278-b283-4969-85b0-42a47715554a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:30 devstack sudo[92974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:37:30 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:30 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" returned: 0 in 0.982s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:30 devstack sudo[92980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e
Jul 07 03:37:30 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:31 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.123s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:31 devstack sudo[92999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 1G
Jul 07 03:37:31 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:31 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" returned: 0 in 0.865s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "cinder-quobyte-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e" released by "delete_volume" :: held 1.933s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Created reservations ['f0650ef7-75d5-4f14-8501-6c7649c23412', '1348a568-0fe5-4b24-b7fa-78544c7f511b', '31d305bf-6682-41e7-a200-fdca2741886c', 'a6e35a77-31ff-4098-9d5a-b95ca93039b3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:31 devstack sudo[93005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:31 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:32 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 1G" returned: 0 in 0.916s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:32 devstack sudo[93010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:32 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:32 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:32 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Deleted volume successfully.
Jul 07 03:37:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9c68f914-474b-4a7b-9e81-a796bc41071e tempest-VolumeQuotasNegativeTestJSON-1938673405 None] Lock "cinder-a2fdbbea-2193-4f7b-a8ae-eceedd02a14e-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:33 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 0.886s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:33 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:37:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:33 devstack sudo[93016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:33 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:33 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:34 devstack sudo[93019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info
Jul 07 03:37:34 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:34 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:34 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:37:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:34 devstack sudo[93023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info
Jul 07 03:37:34 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:35 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.info" returned: 0 in 0.781s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.391s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9aed6ff0-a96d-42a8-96ef-73c786bb7546 tempest-GroupSnapshotsTest-668071879 None] group_snapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: created successfully
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52-69446579-d07c-4d18-bf7a-26eb401ce8d8" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52-69446579-d07c-4d18-bf7a-26eb401ce8d8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Creating volume 69446579-d07c-4d18-bf7a-26eb401ce8d8 from snapshot 6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] snapshot: 6102ccf1-bdd3-486a-8235-03e0e64fcf52, volume: 69446579-d07c-4d18-bf7a-26eb401ce8d8,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9229a5-8045-4983-b5e1-2cd235618b2d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:38 devstack sudo[93130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:38 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:39 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 1.049s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e3ba20-a3b6-4aba-93ba-7b06705d397d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:39 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:37:39 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Flow 'volume_create_manager' (5b41d766-0a44-4c12-9724-dda78a1c04f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae43fe3d-7a4e-4703-8bb9-8ee1be8e12b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae43fe3d-7a4e-4703-8bb9-8ee1be8e12b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-170997865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83095def-db10-4a63-894f-1f55e8cb7cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf681c95fa14a09b712aa436b924af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:40Z,use_quota=True,user_id='e6098264d94d4166a2b8392c7fd5ed45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7cc1f9-eaa9-4057-b00e-e4564f950834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d7cc1f9-eaa9-4057-b00e-e4564f950834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8325e7ff-d52c-44d2-a70d-e74d5d043c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8325e7ff-d52c-44d2-a70d-e74d5d043c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83095def-db10-4a63-894f-1f55e8cb7cdb', 'volume_name': 'volume-83095def-db10-4a63-894f-1f55e8cb7cdb', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcbdc8a-8287-4cb7-8688-1da4c572a8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcbdc8a-8287-4cb7-8688-1da4c572a8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cc049f-3c54-4458-9d5d-052edef7cfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Volume 83095def-db10-4a63-894f-1f55e8cb7cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83095def-db10-4a63-894f-1f55e8cb7cdb', 'volume_size': 1}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:40 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.257s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:37:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:40 devstack sudo[93144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8
Jul 07 03:37:40 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:49 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8" returned: 0 in 8.404s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3b2151-0b09-40cf-9fda-8f72eb5d4852]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:49 devstack sudo[93183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:37:49 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:50 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:50 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff, size 1024.00 MB, duration 8.41 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:37:50 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Converted 1024.00 MB image at 121.82 MB/s
Jul 07 03:37:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:37:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:50 devstack sudo[93189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8
Jul 07 03:37:50 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:51 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8" returned: 0 in 0.736s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" released by "_copy_volume_from_snapshot" :: held 12.848s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52-69446579-d07c-4d18-bf7a-26eb401ce8d8" released by "_create_volume_from_snapshot" :: held 12.914s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.940s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.819s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-170997865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83095def-db10-4a63-894f-1f55e8cb7cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf681c95fa14a09b712aa436b924af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:37:40Z,use_quota=True,user_id='e6098264d94d4166a2b8392c7fd5ed45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Creating volume 83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:37:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:37:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:51 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb 1073741824
Jul 07 03:37:51 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-659b2494-110c-4d51-8151-d2b04db0cc82 tempest-GroupSnapshotsTest-668071879 None] Create group from source-snapshot-5494c7f4-b7a7-49d6-a240-18ad77e8b50a completed successfully.
Jul 07 03:37:52 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb 1073741824" returned: 0 in 1.064s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:52 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb
Jul 07 03:37:52 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb5f085-7feb-4cb0-84e5-7ca500bae753]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:53 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8
Jul 07 03:37:53 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:53 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb" returned: 0 in 1.030s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.155s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cc049f-3c54-4458-9d5d-052edef7cfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83095def-db10-4a63-894f-1f55e8cb7cdb', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab05312-f3dd-4f6e-a8c1-8bc3e55abad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:37:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Volume volume-83095def-db10-4a63-894f-1f55e8cb7cdb (83095def-db10-4a63-894f-1f55e8cb7cdb): created successfully
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab05312-f3dd-4f6e-a8c1-8bc3e55abad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:37:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Flow 'volume_create_manager' (5b41d766-0a44-4c12-9724-dda78a1c04f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:37:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f8f027f5-1da1-4dbb-ba86-d68429cebcfb tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Created volume successfully.
Jul 07 03:37:54 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8" returned: 0 in 1.099s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Creating offline snapshot 89091147-af5e-4fd9-b9f3-867b856634ba of volume 83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:37:54 devstack sudo[93233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8
Jul 07 03:37:54 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f58c484-9304-403b-aab6-bbcfca85a651]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:54 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb
Jul 07 03:37:54 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:55 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-69446579-d07c-4d18-bf7a-26eb401ce8d8" returned: 0 in 0.906s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-69446579-d07c-4d18-bf7a-26eb401ce8d8" released by "delete_volume" :: held 2.088s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['fc33c5b3-d17a-4237-9bc9-755212c53795'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:55 devstack cinder-volume[86955]: WARNING cinder.quota [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1640733932 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1640733932, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:37:55 devstack cinder-volume[86955]: WARNING cinder.quota [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1640733932 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1640733932, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['5d7c771d-f8b7-4a72-b2d4-75536fe1be40', '7955130f-7908-44e7-92d9-e731a0f3cc8c', '55501148-d13f-4e49-88a3-900244ae271d', '53314380-cfbb-4d24-bc57-354d3b266fae'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:37:55 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb" returned: 0 in 1.074s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:55 devstack sudo[93241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba 1G
Jul 07 03:37:55 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:55 devstack sudo[93243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:37:55 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: deleting
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Deleting offline snapshot 6102ccf1-bdd3-486a-8235-03e0e64fcf52 of volume 72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] snapshot_file for this snap is: volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd04aa-a8b7-43e6-a12c-8bce063f9499]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:56 devstack sudo[93246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:56 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:56 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.304s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:56 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:37:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-17c6fde4-9142-4a99-974e-576f813a9d39 tempest-GroupSnapshotsTest-668071879 None] Delete group completed successfully.
Jul 07 03:37:56 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba 1G" returned: 0 in 1.502s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83095def-db10-4a63-894f-1f55e8cb7cdb -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:56 devstack sudo[93268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83095def-db10-4a63-894f-1f55e8cb7cdb -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba
Jul 07 03:37:56 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:57 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 1.222s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20b879c-0971-4839-9bbd-a238db8f56e5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:57 devstack sudo[93273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:37:57 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:57 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83095def-db10-4a63-894f-1f55e8cb7cdb -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba" returned: 0 in 1.064s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:57 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba is being set with open permissions: ugo+rw
Jul 07 03:37:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:58 devstack sudo[93281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba
Jul 07 03:37:58 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:58 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.141s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:58 devstack sudo[93287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:58 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:58 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:59 devstack sudo[93291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info
Jul 07 03:37:59 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:59 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 1.038s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:59 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52
Jul 07 03:37:59 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:37:59 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root
Jul 07 03:37:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info" returned: 0 in 0.803s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:37:59 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info is being set with open permissions: ugo+rw
Jul 07 03:37:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:37:59 devstack sudo[93301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info
Jul 07 03:37:59 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:00 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff.6102ccf1-bdd3-486a-8235-03e0e64fcf52" returned: 0 in 0.784s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6102ccf1-bdd3-486a-8235-03e0e64fcf52" released by "_delete_snapshot" :: held 4.356s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" released by "delete_snapshot" :: held 4.389s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:00 devstack cinder-volume[86955]: WARNING cinder.quota [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1640733932 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1640733932, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] Created reservations ['47acc8ab-c10e-478e-a36c-8801c4d45adc', '829f44ae-1110-4974-8bf7-7541a0a215ef', 'a5bf818d-3d90-4ebd-b10b-f7ee02d37e9c', '5443331d-3042-4b92-8c89-14bc4db94d23'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d7a7a301-e629-4a52-8c31-b6e0c072093f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 5494c7f4-b7a7-49d6-a240-18ad77e8b50a: deleted successfully
Jul 07 03:38:00 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.info" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.349s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b0af93a3-a761-43a5-8a70-9ad524050549 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Create snapshot completed successfully
Jul 07 03:38:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[661475fa-09b3-4461-8373-babe365f7ee8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:01 devstack sudo[93305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:38:01 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "cinder-89091147-af5e-4fd9-b9f3-867b856634ba-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-89091147-af5e-4fd9-b9f3-867b856634ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "cinder-quobyte-89091147-af5e-4fd9-b9f3-867b856634ba" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-89091147-af5e-4fd9-b9f3-867b856634ba" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Deleting offline snapshot 89091147-af5e-4fd9-b9f3-867b856634ba of volume 83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] snapshot_file for this snap is: volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b23fc-9400-4d31-9093-25e72b26284a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:02 devstack sudo[93327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba
Jul 07 03:38:02 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:02 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.162s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:02 devstack sudo[93336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff
Jul 07 03:38:02 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:03 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba" returned: 0 in 0.969s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83095def-db10-4a63-894f-1f55e8cb7cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fbd2c3-60b8-4d07-a55d-d550956fdd22]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:03 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb
Jul 07 03:38:03 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:03 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-72ff77b1-9906-492f-aaef-05b9c8c6dbff" returned: 0 in 1.003s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-72ff77b1-9906-492f-aaef-05b9c8c6dbff" released by "delete_volume" :: held 2.259s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['28af4e63-ab12-4567-9a84-f086b82d3297'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:04 devstack cinder-volume[86955]: WARNING cinder.db.api [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1640733932']
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['96326529-83fb-4873-ba3d-08a57f6b303d', 'c6f484df-afb5-402d-ab4c-e674ac1bb9f5', 'bd96e863-4105-4364-8640-4a38e2d68bf1', 'd4c1cb60-af6e-4d81-b362-3c78496b856b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:04 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:04 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:04 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb" returned: 0 in 0.999s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:04 devstack sudo[93370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba
Jul 07 03:38:04 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:05 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:05 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-84373591-2856-46fb-a9bb-262681bb0cc6 tempest-GroupSnapshotsTest-668071879 None] Delete group completed successfully.
Jul 07 03:38:05 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba" returned: 0 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:05 devstack sudo[93378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba
Jul 07 03:38:05 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-39b5dfd9-7ca4-4beb-8b60-c817be142af2 tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-2127864512: creating
Jul 07 03:38:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-39b5dfd9-7ca4-4beb-8b60-c817be142af2 tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-2127864512: created successfully
Jul 07 03:38:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-39b5dfd9-7ca4-4beb-8b60-c817be142af2 tempest-GroupSnapshotsTest-668071879 None] Create group completed successfully.
Jul 07 03:38:06 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb.89091147-af5e-4fd9-b9f3-867b856634ba" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-89091147-af5e-4fd9-b9f3-867b856634ba" released by "_delete_snapshot" :: held 3.772s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" released by "delete_snapshot" :: held 3.816s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:06 devstack cinder-volume[86955]: WARNING cinder.quota [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Created reservations ['dec29211-5773-4ed8-99db-85daf57bbb39', 'eb42ad14-12eb-4043-8c92-96faa0616f1e', '4aff8c15-072e-49c2-8463-d31bb2f29374', 'cdb66a85-fd3e-4d95-9ca9-765e46a1825a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Delete snapshot completed successfully.
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4fadb673-0e8c-4597-9808-6b4dede72cbd tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-89091147-af5e-4fd9-b9f3-867b856634ba-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "cinder-83095def-db10-4a63-894f-1f55e8cb7cdb-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-83095def-db10-4a63-894f-1f55e8cb7cdb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f38f50-e00f-48a1-b91c-73f6f585da59]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:07 devstack sudo[93382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb
Jul 07 03:38:07 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (b6ff1be6-5a92-42e8-9dcd-fd69dc308ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272101e5-55ae-461b-b73e-d6da7ffb2136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (272101e5-55ae-461b-b73e-d6da7ffb2136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549928375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,host='devstack@QuobyteHD#QuobyteHD',id=e3162fe1-392c-45b8-ac80-7cd590071ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:08Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f10907-68f6-42df-9d93-d42f4d6e6362),volume_type_id=c8f10907-68f6-42df-9d93-d42f4d6e6362)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63030703-ee31-4420-b60f-787454f576d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63030703-ee31-4420-b60f-787454f576d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e282478-7cb1-40e9-a4f0-16b6bceb6d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e282478-7cb1-40e9-a4f0-16b6bceb6d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3162fe1-392c-45b8-ac80-7cd590071ead', 'volume_name': 'volume-e3162fe1-392c-45b8-ac80-7cd590071ead', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3917a5-b93d-4339-a932-f9ce52a201a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3917a5-b93d-4339-a932-f9ce52a201a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e187b-945a-49bb-a7a5-1cbfce291fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Volume e3162fe1-392c-45b8-ac80-7cd590071ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3162fe1-392c-45b8-ac80-7cd590071ead', 'volume_size': 1}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,created_at=2026-07-07T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1549928375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,host='devstack@QuobyteHD#QuobyteHD',id=e3162fe1-392c-45b8-ac80-7cd590071ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:08Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f10907-68f6-42df-9d93-d42f4d6e6362),volume_type_id=c8f10907-68f6-42df-9d93-d42f4d6e6362)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Creating volume e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:07 devstack sudo[93392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead 1073741824
Jul 07 03:38:07 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:07 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb" returned: 0 in 1.029s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:08 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb
Jul 07 03:38:08 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:09 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead 1073741824" returned: 0 in 1.381s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:09 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-83095def-db10-4a63-894f-1f55e8cb7cdb" returned: 0 in 1.262s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:09 devstack sudo[93423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead
Jul 07 03:38:09 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-quobyte-83095def-db10-4a63-894f-1f55e8cb7cdb" released by "delete_volume" :: held 2.409s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Created reservations ['022b718f-d415-4e18-acf2-2d223f6874bc', '910fa921-997d-4d31-8e86-6262d215a17e', 'd4150c02-d44b-4bfc-b6e5-ee43d9cd0524', '2dd4b11a-9a82-4142-8eea-2b7e17d873cc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:09 devstack sudo[93425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:09 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:10 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead" returned: 0 in 0.849s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e187b-945a-49bb-a7a5-1cbfce291fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3162fe1-392c-45b8-ac80-7cd590071ead', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd2f802-ed47-4102-8089-336e60b2c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Volume volume-e3162fe1-392c-45b8-ac80-7cd590071ead (e3162fe1-392c-45b8-ac80-7cd590071ead): created successfully
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd2f802-ed47-4102-8089-336e60b2c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (b6ff1be6-5a92-42e8-9dcd-fd69dc308ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0a6a84ef-876d-4623-b6ef-d223663d1cb9 tempest-GroupSnapshotsTest-668071879 None] Created volume successfully.
Jul 07 03:38:10 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.277s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Deleted volume successfully.
Jul 07 03:38:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-19d342b8-7000-48e5-ad31-84ced76269a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1488392322 None] Lock "cinder-83095def-db10-4a63-894f-1f55e8cb7cdb-delete_volume" released by "delete_volume" :: held 4.014s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (3ff75386-b3b3-49bb-878c-6b39a134a8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8d891-297a-4d5e-a714-38734ad95e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8d891-297a-4d5e-a714-38734ad95e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-447548500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,host='devstack@QuobyteHD#QuobyteHD',id=3ece9073-daa1-4546-9a74-a9e2c6121148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:12Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f10907-68f6-42df-9d93-d42f4d6e6362),volume_type_id=c8f10907-68f6-42df-9d93-d42f4d6e6362)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf8ea6e-0836-4d21-9e74-29919d5f33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf8ea6e-0836-4d21-9e74-29919d5f33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e7e790-48e8-4573-ae54-54bed37d0b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e7e790-48e8-4573-ae54-54bed37d0b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ece9073-daa1-4546-9a74-a9e2c6121148', 'volume_name': 'volume-3ece9073-daa1-4546-9a74-a9e2c6121148', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17600876-d9ee-4221-9cd4-c2c9e05a8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17600876-d9ee-4221-9cd4-c2c9e05a8e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ad7d55-c61e-40e3-9f92-985981131651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Volume 3ece9073-daa1-4546-9a74-a9e2c6121148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ece9073-daa1-4546-9a74-a9e2c6121148', 'volume_size': 1}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,created_at=2026-07-07T01:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-447548500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a0c16bf6-3b9e-4e50-a293-4b3b39034954,host='devstack@QuobyteHD#QuobyteHD',id=3ece9073-daa1-4546-9a74-a9e2c6121148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:12Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8f10907-68f6-42df-9d93-d42f4d6e6362),volume_type_id=c8f10907-68f6-42df-9d93-d42f4d6e6362)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Creating volume 3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:12 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 1073741824
Jul 07 03:38:12 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:13 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 1073741824" returned: 0 in 1.021s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:13 devstack sudo[93457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148
Jul 07 03:38:13 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:14 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148" returned: 0 in 0.763s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ad7d55-c61e-40e3-9f92-985981131651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ece9073-daa1-4546-9a74-a9e2c6121148', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc69d1e-da60-4559-ba52-034920d4f2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Volume volume-3ece9073-daa1-4546-9a74-a9e2c6121148 (3ece9073-daa1-4546-9a74-a9e2c6121148): created successfully
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc69d1e-da60-4559-ba52-034920d4f2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (3ff75386-b3b3-49bb-878c-6b39a134a8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-296089d8-7378-4ad9-8e59-a14704c33955 tempest-GroupSnapshotsTest-668071879 None] Created volume successfully.
Jul 07 03:38:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2d1c3871-665c-4dc7-b1db-13ebca4a8c05 tempest-GroupSnapshotsTest-668071879 None] Update group completed successfully.
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:15 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:15 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Flow 'volume_create_manager' (fccc271d-8f72-446c-b2a5-2d9a98a00a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e970d2-2802-441c-93e6-d6299c9498ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e970d2-2802-441c-93e6-d6299c9498ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-531909322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2329e9-2a74-4c03-99da-5f4cef7b052c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd58cb1aa62465abddef767c3541a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:16Z,use_quota=True,user_id='57a1e43183c44b1e9e7b96dd52594068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f616e96a-d68a-46c0-a10d-d2dc07624a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f616e96a-d68a-46c0-a10d-d2dc07624a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a39adf4-f77b-4c6f-b559-687dfe25d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a39adf4-f77b-4c6f-b559-687dfe25d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec2329e9-2a74-4c03-99da-5f4cef7b052c', 'volume_name': 'volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b90db36-4e65-429e-9a0b-182afbfbc25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b90db36-4e65-429e-9a0b-182afbfbc25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d77267-1629-48af-8070-574d68306dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Volume ec2329e9-2a74-4c03-99da-5f4cef7b052c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c', 'volume_size': 1}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-531909322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec2329e9-2a74-4c03-99da-5f4cef7b052c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd58cb1aa62465abddef767c3541a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:16Z,use_quota=True,user_id='57a1e43183c44b1e9e7b96dd52594068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Creating volume ec2329e9-2a74-4c03-99da-5f4cef7b052c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:15 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c 1073741824
Jul 07 03:38:15 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:16 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.946s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:38:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:38:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:38:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5e2d9073-8ce5-4c10-9b7e-0c4466fae53a tempest-GroupSnapshotsTest-668071879 None] Update group completed successfully.
Jul 07 03:38:16 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c 1073741824" returned: 0 in 1.125s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:17 devstack sudo[93535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c
Jul 07 03:38:17 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc581ebd-219f-4d39-a123-87ae86bba793 tempest-GroupSnapshotsTest-668071879 None] Update group completed successfully.
Jul 07 03:38:17 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c" returned: 0 in 0.843s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d77267-1629-48af-8070-574d68306dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a415a91-fce0-41e6-bd5d-8c9a1ec133b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Volume volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c (ec2329e9-2a74-4c03-99da-5f4cef7b052c): created successfully
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a415a91-fce0-41e6-bd5d-8c9a1ec133b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Flow 'volume_create_manager' (fccc271d-8f72-446c-b2a5-2d9a98a00a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-965e2019-74c8-4117-a7dd-480ce58bf87d tempest-ServersNegativeTestJSON-1978492766 None] Created volume successfully.
Jul 07 03:38:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91f65bf0-59c7-4d30-93e6-74c33ea132cb tempest-GroupSnapshotsTest-668071879 None] Update group completed successfully.
Jul 07 03:38:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] GroupSnapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: creating.
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Group snapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Creating offline snapshot 5033aae2-87c7-4f4b-98d3-ac6379272270 of volume e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d76de74-f8de-4311-86f1-e1bfd0f63228]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:20 devstack sudo[93542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead
Jul 07 03:38:20 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Flow 'volume_create_manager' (135d86b0-ad32-4879-81f3-db9e3c100bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3413b318-125c-4af2-a4f6-3777c26ccf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3413b318-125c-4af2-a4f6-3777c26ccf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545701588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1e651d-cad7-4543-81d3-3c74794d2047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd58cb1aa62465abddef767c3541a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:22Z,use_quota=True,user_id='57a1e43183c44b1e9e7b96dd52594068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be6b205-ccf6-430a-a9c4-569de70bc884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be6b205-ccf6-430a-a9c4-569de70bc884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ea0e97-1262-49e7-94ce-8133b5cd21fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ea0e97-1262-49e7-94ce-8133b5cd21fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1e651d-cad7-4543-81d3-3c74794d2047', 'volume_name': 'volume-1f1e651d-cad7-4543-81d3-3c74794d2047', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf862eb-835a-4e5b-9e3b-401f07ca6069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf862eb-835a-4e5b-9e3b-401f07ca6069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5b857c-3d09-47f3-8455-ef9ddfd19483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Volume 1f1e651d-cad7-4543-81d3-3c74794d2047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1e651d-cad7-4543-81d3-3c74794d2047', 'volume_size': 1}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:22 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead" returned: 0 in 1.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:22 devstack sudo[93551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 1G
Jul 07 03:38:22 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:23 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 1G" returned: 0 in 0.914s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3162fe1-392c-45b8-ac80-7cd590071ead -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:23 devstack sudo[93557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3162fe1-392c-45b8-ac80-7cd590071ead -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270
Jul 07 03:38:23 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:23 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3162fe1-392c-45b8-ac80-7cd590071ead -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:24 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270
Jul 07 03:38:24 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:24 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:24 devstack sudo[93566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info
Jul 07 03:38:24 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:25 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info" returned: 0 in 0.745s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:25 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:25 devstack sudo[93569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info
Jul 07 03:38:25 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:26 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.info" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.592s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=79,cinder:SELECT=89,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Creating offline snapshot 73dcb16f-96cb-43e5-a1eb-b71f90397bc2 of volume 3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4330951-6367-4d1f-96de-9b2623f04e5f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:26 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148
Jul 07 03:38:26 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:27 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148" returned: 0 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:27 devstack sudo[93577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 1G
Jul 07 03:38:27 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:28 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 1G" returned: 0 in 0.925s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece9073-daa1-4546-9a74-a9e2c6121148 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:28 devstack sudo[93582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece9073-daa1-4546-9a74-a9e2c6121148 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2
Jul 07 03:38:28 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:28 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ece9073-daa1-4546-9a74-a9e2c6121148 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2" returned: 0 in 0.730s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:28 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:28 devstack sudo[93588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2
Jul 07 03:38:28 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:29 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:29 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=79,cinder:SELECT=72,cinder:INSERT=16,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:38:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:29 devstack sudo[93605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info
Jul 07 03:38:29 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:30 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info" returned: 0 in 0.682s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:30 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:30 devstack sudo[93608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info
Jul 07 03:38:30 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:30 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.info" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.729s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.613s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1545701588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1e651d-cad7-4543-81d3-3c74794d2047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbd58cb1aa62465abddef767c3541a12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:22Z,use_quota=True,user_id='57a1e43183c44b1e9e7b96dd52594068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Creating volume 1f1e651d-cad7-4543-81d3-3c74794d2047 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:30 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 1073741824
Jul 07 03:38:30 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6a6c8757-c9c8-420f-89b6-7beb1b98df47 tempest-GroupSnapshotsTest-668071879 None] group_snapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: created successfully
Jul 07 03:38:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: deleting
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-5033aae2-87c7-4f4b-98d3-ac6379272270" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-5033aae2-87c7-4f4b-98d3-ac6379272270" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Deleting offline snapshot 5033aae2-87c7-4f4b-98d3-ac6379272270 of volume e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] snapshot_file for this snap is: volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d7efee-1dc2-4ada-a6bc-f0d641667dca]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:31 devstack sudo[93613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270
Jul 07 03:38:31 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:31 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 1073741824" returned: 0 in 0.950s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:31 devstack sudo[93619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047
Jul 07 03:38:31 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:32 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270" returned: 0 in 0.837s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3162fe1-392c-45b8-ac80-7cd590071ead(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6147e7-00e9-4089-9665-8e270f2464cc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:32 devstack sudo[93624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead
Jul 07 03:38:32 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:32 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5b857c-3d09-47f3-8455-ef9ddfd19483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1e651d-cad7-4543-81d3-3c74794d2047', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5add08-9fd1-4388-a0b8-a0aaff5c22d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Volume volume-1f1e651d-cad7-4543-81d3-3c74794d2047 (1f1e651d-cad7-4543-81d3-3c74794d2047): created successfully
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5add08-9fd1-4388-a0b8-a0aaff5c22d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Flow 'volume_create_manager' (135d86b0-ad32-4879-81f3-db9e3c100bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d090952f-fcc9-4657-bc54-742edd35c533 tempest-ServersNegativeTestJSON-1978492766 None] Created volume successfully.
Jul 07 03:38:33 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead" returned: 0 in 0.877s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:33 devstack sudo[93630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270
Jul 07 03:38:33 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "cinder-1f1e651d-cad7-4543-81d3-3c74794d2047-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-1f1e651d-cad7-4543-81d3-3c74794d2047-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "cinder-quobyte-1f1e651d-cad7-4543-81d3-3c74794d2047" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-quobyte-1f1e651d-cad7-4543-81d3-3c74794d2047" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9173dc8-7b2a-4ce3-b461-831202cf8b70]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:33 devstack sudo[93632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047
Jul 07 03:38:33 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:33 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270" returned: 0 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:34 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270
Jul 07 03:38:34 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:34 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:34 devstack sudo[93643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047
Jul 07 03:38:34 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:34 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead.5033aae2-87c7-4f4b-98d3-ac6379272270" returned: 0 in 0.699s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-5033aae2-87c7-4f4b-98d3-ac6379272270" released by "_delete_snapshot" :: held 3.313s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" released by "delete_snapshot" :: held 3.354s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-73dcb16f-96cb-43e5-a1eb-b71f90397bc2" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-73dcb16f-96cb-43e5-a1eb-b71f90397bc2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Deleting offline snapshot 73dcb16f-96cb-43e5-a1eb-b71f90397bc2 of volume 3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] snapshot_file for this snap is: volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7125348-cb25-4ee9-a766-d58808f72a8b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:34 devstack sudo[93647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2
Jul 07 03:38:34 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:34 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1f1e651d-cad7-4543-81d3-3c74794d2047" returned: 0 in 0.686s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-quobyte-1f1e651d-cad7-4543-81d3-3c74794d2047" released by "delete_volume" :: held 1.559s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Created reservations ['93fecb5c-5868-4318-8596-20587f8c6361', '7572ebf7-339d-4378-b6b5-609fe0dc69c4', 'ac832214-6907-4028-a574-d46d06813e0d', 'cbeaab39-ac71-4224-a972-456844c12c84'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:35 devstack sudo[93649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:35 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:35 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "cinder-ec2329e9-2a74-4c03-99da-5f4cef7b052c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2" returned: 0 in 0.853s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ece9073-daa1-4546-9a74-a9e2c6121148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-ec2329e9-2a74-4c03-99da-5f4cef7b052c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e033a-ad55-4003-8ee3-b095a2d03aae]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "cinder-quobyte-ec2329e9-2a74-4c03-99da-5f4cef7b052c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:35 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-quobyte-ec2329e9-2a74-4c03-99da-5f4cef7b052c" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Deleted volume successfully.
Jul 07 03:38:35 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148
Jul 07 03:38:35 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c72af60-cf23-4450-ae80-5671b05cb8ec]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f0ac9704-1812-4eb9-a7dd-34de5d7adfd4 tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-1f1e651d-cad7-4543-81d3-3c74794d2047-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:36 devstack sudo[93658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c
Jul 07 03:38:36 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:36 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Flow 'volume_create_manager' (e07e473f-067c-46c1-bbe0-3b2930fcbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:36 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033cd593-d589-4b44-ad21-1839ba393b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148" returned: 0 in 1.263s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:37 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2
Jul 07 03:38:37 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033cd593-d589-4b44-ad21-1839ba393b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1133841505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb064177-2b4e-4d46-a1a7-a0260ad56c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64e421db6cd4f0eb05a714ebde086d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:37Z,use_quota=True,user_id='6fec57774a2f4874acdcebf6063a2d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7991ead1-64d2-4a7e-881a-97cdc7afc15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7991ead1-64d2-4a7e-881a-97cdc7afc15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf5b11a-18d1-48a9-bdf4-66b6a9d2d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf5b11a-18d1-48a9-bdf4-66b6a9d2d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb064177-2b4e-4d46-a1a7-a0260ad56c64', 'volume_name': 'volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d01364-3603-4e9c-8f60-1bca64159abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d01364-3603-4e9c-8f60-1bca64159abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38e55ef-36a6-4a3c-b1e7-b166e8790ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Volume eb064177-2b4e-4d46-a1a7-a0260ad56c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64', 'volume_size': 1}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1133841505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb064177-2b4e-4d46-a1a7-a0260ad56c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64e421db6cd4f0eb05a714ebde086d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:37Z,use_quota=True,user_id='6fec57774a2f4874acdcebf6063a2d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Creating volume eb064177-2b4e-4d46-a1a7-a0260ad56c64 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:37 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c" returned: 0 in 1.198s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:37 devstack sudo[93704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 1073741824
Jul 07 03:38:37 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:37 devstack sudo[93705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c
Jul 07 03:38:37 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:37 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ec2329e9-2a74-4c03-99da-5f4cef7b052c" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:37 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-quobyte-ec2329e9-2a74-4c03-99da-5f4cef7b052c" released by "delete_volume" :: held 1.987s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:37 devstack sudo[93716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2
Jul 07 03:38:37 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Created reservations ['f22a16f9-055a-4bc8-be12-675fa491ca7d', '7e7d5884-fb92-4073-8cd0-8b3b06fe0484', '467d9501-6394-467c-8cf2-d86c849dc302', '5f5b83bf-057d-4c8f-95c2-99723652750a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:38 devstack sudo[93719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:38 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:38 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 1073741824" returned: 0 in 1.019s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:38 devstack sudo[93721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64
Jul 07 03:38:38 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:38 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148.73dcb16f-96cb-43e5-a1eb-b71f90397bc2" returned: 0 in 0.686s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-73dcb16f-96cb-43e5-a1eb-b71f90397bc2" released by "_delete_snapshot" :: held 3.758s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" released by "delete_snapshot" :: held 3.790s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:38 devstack cinder-volume[86955]: WARNING cinder.quota [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1978290269 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1978290269, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:38:38 devstack cinder-volume[86955]: WARNING cinder.quota [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1978290269 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1978290269, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:38:38 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Created reservations ['490eeb70-6111-4e8f-af5d-8b5abcd61728', 'a980a104-396b-4994-bb31-7f26c4c857e6', '8e725932-64b1-4d56-b503-875c984af2a4', 'deb4fe69-2015-423d-bd86-674522d8db56'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.672s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Deleted volume successfully.
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c55389c0-7143-43d6-aa67-9f0670762e3f tempest-ServersNegativeTestJSON-1978492766 None] Lock "cinder-ec2329e9-2a74-4c03-99da-5f4cef7b052c-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] Created reservations ['8689f907-a3d9-4845-ae8a-5d8541d88b38', '17d02495-0ce9-4792-9c56-c84961494e49', '04a09c99-5469-450e-bebd-2d48f348fc30', '60127c50-fc83-4c52-a175-260a4176701b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:38 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38e55ef-36a6-4a3c-b1e7-b166e8790ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2538d99-0c1a-4003-b133-e93a34473a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Volume volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 (eb064177-2b4e-4d46-a1a7-a0260ad56c64): created successfully
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2538d99-0c1a-4003-b133-e93a34473a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Flow 'volume_create_manager' (e07e473f-067c-46c1-bbe0-3b2930fcbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94cf0cf6-f2b6-4c9c-b8cc-523de3b0fb4f tempest-GroupSnapshotsTest-668071879 None] group_snapshot 3fec2024-7b0b-4bf8-a664-a5c50abeeea6: deleted successfully
Jul 07 03:38:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f52c32d1-42a6-427f-9611-b2ec5e59ff36 tempest-VolumesTransfersV355Test-304220795 None] Created volume successfully.
Jul 07 03:38:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d433da2-8a33-4586-9291-e29df7e2e50f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aa0c210e-ecff-479f-8065-b4040a59c1e8 tempest-VolumesTransfersV355Test-662274261 None] Transfer volume completed successfully.
Jul 07 03:38:39 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148
Jul 07 03:38:39 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:40 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148" returned: 0 in 0.800s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:40 devstack sudo[93734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148
Jul 07 03:38:40 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "cinder-eb064177-2b4e-4d46-a1a7-a0260ad56c64-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-eb064177-2b4e-4d46-a1a7-a0260ad56c64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "cinder-quobyte-eb064177-2b4e-4d46-a1a7-a0260ad56c64" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-quobyte-eb064177-2b4e-4d46-a1a7-a0260ad56c64" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0562a-266f-410a-98ba-4fae4edef5a0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:40 devstack sudo[93740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64
Jul 07 03:38:40 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:41 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ece9073-daa1-4546-9a74-a9e2c6121148" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-3ece9073-daa1-4546-9a74-a9e2c6121148" released by "delete_volume" :: held 1.693s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c838edf2-95ec-4cd6-8637-9df23c79d3ce]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:41 devstack sudo[93759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead
Jul 07 03:38:41 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:42 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64" returned: 0 in 1.272s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:42 devstack sudo[93766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64
Jul 07 03:38:42 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (24e50170-b28b-4181-bb64-81097c185954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e01b06-380b-42fd-be55-0cbe58c228ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80e01b06-380b-42fd-be55-0cbe58c228ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1613654213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340163fb-c2b6-426c-bae5-a333642a7014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:42Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c285e4-13c0-4c1b-8e0d-da58804b6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c285e4-13c0-4c1b-8e0d-da58804b6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a75f438-b671-4332-ab41-f2242728403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a75f438-b671-4332-ab41-f2242728403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340163fb-c2b6-426c-bae5-a333642a7014', 'volume_name': 'volume-340163fb-c2b6-426c-bae5-a333642a7014', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d8912-9218-4273-85a2-a63a6b183708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207d8912-9218-4273-85a2-a63a6b183708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc90af1-483f-4409-a872-7e503c51b937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Volume 340163fb-c2b6-426c-bae5-a333642a7014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340163fb-c2b6-426c-bae5-a333642a7014', 'volume_size': 1}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1613654213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340163fb-c2b6-426c-bae5-a333642a7014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:42Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Creating volume 340163fb-c2b6-426c-bae5-a333642a7014 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:42 devstack sudo[93768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 1073741824
Jul 07 03:38:42 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:42 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead" returned: 0 in 1.208s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:42 devstack sudo[93775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead
Jul 07 03:38:42 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:42 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eb064177-2b4e-4d46-a1a7-a0260ad56c64" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-quobyte-eb064177-2b4e-4d46-a1a7-a0260ad56c64" released by "delete_volume" :: held 2.142s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Created reservations ['0c4f2de0-7804-45d4-91b7-2f09512f5d7f', '1bc6c306-154c-423f-b804-15e7e392ac28', '2c4ec960-6cee-4cb4-aae0-1e3bfc529e0f', 'b1d5b239-620a-42c0-8dab-0be405379ead'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:43 devstack sudo[93782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:43 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:43 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e3162fe1-392c-45b8-ac80-7cd590071ead" returned: 0 in 0.853s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-e3162fe1-392c-45b8-ac80-7cd590071ead" released by "delete_volume" :: held 2.187s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['92e087c8-b1ef-42bf-aff4-0749d51a4c36'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:43 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 1073741824" returned: 0 in 1.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:43 devstack cinder-volume[86955]: WARNING cinder.quota [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1978290269 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1978290269, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:43 devstack sudo[93786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014
Jul 07 03:38:43 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['297ca48f-9e95-42d9-ae7c-28d2a0840d58', 'd6ca510c-5801-40ce-9db1-f78f437418fc', 'e70a5a5b-2f15-4612-8148-10d76c495a9d', '9a0f2368-e792-4e92-8ce9-00b54e055766'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['dcfde2e4-0b01-443f-9d86-3b651dca4c7f', '450621ad-dd5f-41c0-8d7a-3a72ffd81651', '06f76b79-1a18-46be-8619-1f00d02c7e36', '7ac4dbd0-c9a0-450c-a440-20a737e2cda3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Flow 'volume_create_manager' (2522445e-5329-446a-b496-27b3a3095b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38484e14-a355-4a51-a719-3a2a45e3f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38484e14-a355-4a51-a719-3a2a45e3f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2144238929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45665ee6-eb82-43cc-bfb5-6fb3e9509ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64e421db6cd4f0eb05a714ebde086d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:44Z,use_quota=True,user_id='6fec57774a2f4874acdcebf6063a2d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7c5648-fa67-46e2-8492-f40b9543d8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7c5648-fa67-46e2-8492-f40b9543d8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8bb43c-b03e-4b94-b3b2-fc8a0575d48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8bb43c-b03e-4b94-b3b2-fc8a0575d48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45665ee6-eb82-43cc-bfb5-6fb3e9509ca9', 'volume_name': 'volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d3b88b-bb18-40b9-9922-a0ce89ccfd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d3b88b-bb18-40b9-9922-a0ce89ccfd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12725736-b09c-4b9b-a173-011af42543c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Volume 45665ee6-eb82-43cc-bfb5-6fb3e9509ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9', 'volume_size': 1}
Jul 07 03:38:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:44 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.985s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Deleted volume successfully.
Jul 07 03:38:44 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:44 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6899aa46-d161-4b5b-84de-8d3af150caf3 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-eb064177-2b4e-4d46-a1a7-a0260ad56c64-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:44 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2144238929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45665ee6-eb82-43cc-bfb5-6fb3e9509ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64e421db6cd4f0eb05a714ebde086d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:44Z,use_quota=True,user_id='6fec57774a2f4874acdcebf6063a2d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Creating volume 45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc90af1-483f-4409-a872-7e503c51b937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340163fb-c2b6-426c-bae5-a333642a7014', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578ee190-bcb7-4bd3-914a-0262857a4d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:44 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 1073741824
Jul 07 03:38:44 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Volume volume-340163fb-c2b6-426c-bae5-a333642a7014 (340163fb-c2b6-426c-bae5-a333642a7014): created successfully
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578ee190-bcb7-4bd3-914a-0262857a4d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (24e50170-b28b-4181-bb64-81097c185954) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-906c5f6b-d861-422d-a0e8-646156855bd2 tempest-AttachVolumeNegativeTest-1233159795 None] Created volume successfully.
Jul 07 03:38:44 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.750s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6708b6cf-57b8-40cd-b1af-06cf74f74753 tempest-GroupSnapshotsTest-668071879 None] Delete group completed successfully.
Jul 07 03:38:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-707a0b82-7435-4c80-a73e-69155be5d18e tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-1674217515: creating
Jul 07 03:38:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-707a0b82-7435-4c80-a73e-69155be5d18e tempest-GroupSnapshotsTest-668071879 None] Group tempest-GroupSnapshotsTest-Group-1674217515: created successfully
Jul 07 03:38:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-707a0b82-7435-4c80-a73e-69155be5d18e tempest-GroupSnapshotsTest-668071879 None] Create group completed successfully.
Jul 07 03:38:45 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 1073741824" returned: 0 in 0.961s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:45 devstack sudo[93799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9
Jul 07 03:38:45 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:46 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" returned: 0 in 0.728s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12725736-b09c-4b9b-a173-011af42543c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6836f26-0b73-4f0d-a7d3-9831ae81ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Volume volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 (45665ee6-eb82-43cc-bfb5-6fb3e9509ca9): created successfully
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6836f26-0b73-4f0d-a7d3-9831ae81ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Flow 'volume_create_manager' (2522445e-5329-446a-b496-27b3a3095b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-00b4048c-07c5-40b5-aed6-1aab05206386 tempest-VolumesTransfersV355Test-304220795 None] Created volume successfully.
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (1117e29a-65ac-4bb5-9e8c-cce0af2e8110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efc6bef-b344-4efb-a8c9-8eef7af9e8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9efc6bef-b344-4efb-a8c9-8eef7af9e8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086834126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3942612b-95a9-4f2e-a992-b80857ccfcae,host='devstack@QuobyteHD#QuobyteHD',id=70ec031e-4f8e-4b22-8af0-52aabe863fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:47Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd51313-872e-4914-b57e-7e42d5fab50a),volume_type_id=6dd51313-872e-4914-b57e-7e42d5fab50a)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36ac101-17f1-4048-a789-bac44cd52536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36ac101-17f1-4048-a789-bac44cd52536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07a82de-d838-4879-86c8-eaf68e5e60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07a82de-d838-4879-86c8-eaf68e5e60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ec031e-4f8e-4b22-8af0-52aabe863fed', 'volume_name': 'volume-70ec031e-4f8e-4b22-8af0-52aabe863fed', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3e1c4-5e06-468b-b311-0653aa165348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab3e1c4-5e06-468b-b311-0653aa165348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e11a250-fce7-466b-b4b0-a39d8a751a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Volume 70ec031e-4f8e-4b22-8af0-52aabe863fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ec031e-4f8e-4b22-8af0-52aabe863fed', 'volume_size': 1}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3942612b-95a9-4f2e-a992-b80857ccfcae,created_at=2026-07-07T01:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2086834126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3942612b-95a9-4f2e-a992-b80857ccfcae,host='devstack@QuobyteHD#QuobyteHD',id=70ec031e-4f8e-4b22-8af0-52aabe863fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a3493a00c84f2dac910e1046f9057f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:47Z,use_quota=True,user_id='83a996559f5d49d3baf2acfda758e3b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd51313-872e-4914-b57e-7e42d5fab50a),volume_type_id=6dd51313-872e-4914-b57e-7e42d5fab50a)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Creating volume 70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:46 devstack sudo[93807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed 1073741824
Jul 07 03:38:46 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "cinder-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "cinder-quobyte-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-quobyte-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50276b9-1e14-4679-b078-90ae7bebe693]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:47 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9
Jul 07 03:38:47 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:47 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed 1073741824" returned: 0 in 1.168s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:47 devstack sudo[93825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed
Jul 07 03:38:47 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:48 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:48 devstack sudo[93831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9
Jul 07 03:38:48 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:48 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.042s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e11a250-fce7-466b-b4b0-a39d8a751a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ec031e-4f8e-4b22-8af0-52aabe863fed', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786f51d-34ce-4471-a616-d3ef29ef33db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[00723556-6617-490d-825f-e8247c278804]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Volume volume-70ec031e-4f8e-4b22-8af0-52aabe863fed (70ec031e-4f8e-4b22-8af0-52aabe863fed): created successfully
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786f51d-34ce-4471-a616-d3ef29ef33db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Flow 'volume_create_manager' (1117e29a-65ac-4bb5-9e8c-cce0af2e8110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-937bacf0-bc88-49f1-b1f3-f4e5f496ce65 tempest-GroupSnapshotsTest-668071879 None] Created volume successfully.
Jul 07 03:38:48 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014
Jul 07 03:38:48 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:49 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-quobyte-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9" released by "delete_volume" :: held 1.776s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Created reservations ['68db9bfc-00d3-4a6d-8673-63bfda8f4193', '2222d559-fbb2-4584-bfe6-71f0da1fb43a', 'a6776f46-0000-44a0-b51d-a31f520e5fd4', 'b0a74826-bda4-41d1-a199-167905e62e21'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:38:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] GroupSnapshot 94ae570d-1878-4a23-90e4-61b57cef7258: creating.
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Group snapshot 94ae570d-1878-4a23-90e4-61b57cef7258: creating. {{(pid=86955) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:49 devstack sudo[93846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:38:49 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:49 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014" returned: 0 in 0.926s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.960s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.219s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Creating offline snapshot 6d5222e2-ea57-4905-a4ff-0e71718ec81e of volume 70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1ad15e-3a7c-4ceb-9fee-4b11f3b23d1c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-340163fb-c2b6-426c-bae5-a333642a7014', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1eecba3c-5a99-43bc-8ee9-9ded67018296', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:38:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-581108fa-23fa-42d9-b61d-3755e1eb598a req-063b0b96-d8c5-4205-9ee0-f811d20ef211 tempest-AttachVolumeNegativeTest-1233159795 None] attachment_update completed successfully.
Jul 07 03:38:49 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed
Jul 07 03:38:49 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:50 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.893s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:38:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Deleted volume successfully.
Jul 07 03:38:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a95f636a-45cd-4b83-8698-903389302440 tempest-VolumesTransfersV355Test-379053167 None] Lock "cinder-45665ee6-eb82-43cc-bfb5-6fb3e9509ca9-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:38:50 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed" returned: 0 in 1.084s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:50 devstack sudo[93924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e 1G
Jul 07 03:38:50 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:51 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e 1G" returned: 0 in 1.149s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ec031e-4f8e-4b22-8af0-52aabe863fed -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:52 devstack sudo[94246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ec031e-4f8e-4b22-8af0-52aabe863fed -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e
Jul 07 03:38:52 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:52 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ec031e-4f8e-4b22-8af0-52aabe863fed -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e" returned: 0 in 0.842s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:52 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:52 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e
Jul 07 03:38:52 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:53 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:53 devstack sudo[94260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info
Jul 07 03:38:53 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:54 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:38:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:54 devstack sudo[94263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info
Jul 07 03:38:54 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:55 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.info" returned: 0 in 0.784s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.425s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a4798333-85d5-4b21-958e-b97efe7c3c5a tempest-GroupSnapshotsTest-668071879 None] group_snapshot 94ae570d-1878-4a23-90e4-61b57cef7258: created successfully
Jul 07 03:38:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] group_snapshot 94ae570d-1878-4a23-90e4-61b57cef7258: deleting
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Flow 'volume_create_manager' (c22cfe49-e02c-4fc0-af59-36528c842dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2410d0-9c0c-4394-b6c0-83468a28da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2410d0-9c0c-4394-b6c0-83468a28da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-794448314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a534902aa95a42c08db4e22f7a78b67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:56Z,use_quota=True,user_id='b5b8d3e0862d4e0d9a7eb4aed0052192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb2c2cf-8f65-4d67-bddf-e1fc812b9d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb2c2cf-8f65-4d67-bddf-e1fc812b9d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29df1cb1-9ea9-4e3e-9687-ccc66a475dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29df1cb1-9ea9-4e3e-9687-ccc66a475dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f', 'volume_name': 'volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b8384c-5aa2-4db5-8d6f-b5759df3eb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b8384c-5aa2-4db5-8d6f-b5759df3eb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a84d38e-1c58-43dd-89a4-54e464d4eb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:56 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Volume bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f', 'volume_size': 1}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-794448314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a534902aa95a42c08db4e22f7a78b67d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:56Z,use_quota=True,user_id='b5b8d3e0862d4e0d9a7eb4aed0052192',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Creating volume bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:56 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] group_snapshot 94ae570d-1878-4a23-90e4-61b57cef7258: deleting {{(pid=86955) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 03:38:56 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f 1073741824
Jul 07 03:38:56 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-6d5222e2-ea57-4905-a4ff-0e71718ec81e" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6d5222e2-ea57-4905-a4ff-0e71718ec81e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Deleting offline snapshot 6d5222e2-ea57-4905-a4ff-0e71718ec81e of volume 70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] snapshot_file for this snap is: volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd7e119-9248-4087-9533-16e32ddac176]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:56 devstack sudo[94268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e
Jul 07 03:38:56 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:57 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f 1073741824" returned: 0 in 1.074s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:57 devstack sudo[94278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f
Jul 07 03:38:57 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:57 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e" returned: 0 in 1.051s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ec031e-4f8e-4b22-8af0-52aabe863fed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[09287e2f-43a7-4a44-b5d9-8a7c00afed06]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:57 devstack sudo[94280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed
Jul 07 03:38:57 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:58 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a84d38e-1c58-43dd-89a4-54e464d4eb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb99603-b334-4fd1-a4f1-0e2f7c481ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Volume volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f (bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f): created successfully
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb99603-b334-4fd1-a4f1-0e2f7c481ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Flow 'volume_create_manager' (c22cfe49-e02c-4fc0-af59-36528c842dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f64e7e4c-8a3a-4aad-b8f8-c5a149f92130 req-5a6f9116-a27e-4abc-b496-2f40f71805c9 tempest-VolumesGetTestJSON-1544490303 None] Created volume successfully.
Jul 07 03:38:58 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed" returned: 0 in 0.893s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:58 devstack sudo[94286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e
Jul 07 03:38:58 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Flow 'volume_create_manager' (79cbaa93-3a5b-4550-abe2-f9b28ab62544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80bdae8-b1ec-42e3-bd1b-9783f6794381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80bdae8-b1ec-42e3-bd1b-9783f6794381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1363877972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49939852-f538-4035-a271-5aba0435a1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef79119fc84ff9bc739b31f5626370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:58Z,use_quota=True,user_id='f51752ee248540248f4bb943d88a224e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c38817-2e62-41d5-ad2f-1ec86452ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c38817-2e62-41d5-ad2f-1ec86452ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03098f0-cc19-460e-898f-9e797946c8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03098f0-cc19-460e-898f-9e797946c8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49939852-f538-4035-a271-5aba0435a1a1', 'volume_name': 'volume-49939852-f538-4035-a271-5aba0435a1a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c1dddf-3806-48fb-b4a5-67ab0698c62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c1dddf-3806-48fb-b4a5-67ab0698c62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cfbd4b-49d8-49ae-b3cb-c5df7142d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:38:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Volume 49939852-f538-4035-a271-5aba0435a1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49939852-f538-4035-a271-5aba0435a1a1', 'volume_size': 1}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1363877972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49939852-f538-4035-a271-5aba0435a1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef79119fc84ff9bc739b31f5626370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:38:58Z,use_quota=True,user_id='f51752ee248540248f4bb943d88a224e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Creating volume 49939852-f538-4035-a271-5aba0435a1a1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:38:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:38:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:58 devstack sudo[94292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 1073741824
Jul 07 03:38:58 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Acquiring lock "cinder-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "cinder-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Acquiring lock "cinder-quobyte-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "cinder-quobyte-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d7d04-6d0c-49c6-bada-935d95c0833d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:59 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f
Jul 07 03:38:59 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:59 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e" returned: 0 in 1.006s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:59 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e
Jul 07 03:38:59 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:38:59 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 1073741824" returned: 0 in 1.003s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:38:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:38:59 devstack sudo[94307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1
Jul 07 03:38:59 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:00 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" returned: 0 in 0.874s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:00 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f
Jul 07 03:39:00 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:00 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed.6d5222e2-ea57-4905-a4ff-0e71718ec81e" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-6d5222e2-ea57-4905-a4ff-0e71718ec81e" released by "_delete_snapshot" :: held 3.780s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" released by "delete_snapshot" :: held 3.822s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:00 devstack cinder-volume[86955]: WARNING cinder.quota [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1320165266 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1320165266, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:39:00 devstack cinder-volume[86955]: WARNING cinder.quota [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1320165266 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1320165266, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['d09ce6f3-889d-420c-b538-7722bfe0d4da', '3e2eb566-9a99-45a3-abbc-d0a58f89f91a', '88d9756d-a82f-45a5-825c-7b45e78b1b52', 'bed87cf5-d0d5-4cbd-99c8-52492ff65742'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2ced004c-a42d-4597-8b4a-1a58eb9ba533 tempest-GroupSnapshotsTest-668071879 None] group_snapshot 94ae570d-1878-4a23-90e4-61b57cef7258: deleted successfully
Jul 07 03:39:00 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1" returned: 0 in 0.708s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cfbd4b-49d8-49ae-b3cb-c5df7142d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49939852-f538-4035-a271-5aba0435a1a1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d037f-8536-4d01-a637-50d17a0e8fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Volume volume-49939852-f538-4035-a271-5aba0435a1a1 (49939852-f538-4035-a271-5aba0435a1a1): created successfully
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d037f-8536-4d01-a637-50d17a0e8fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Flow 'volume_create_manager' (79cbaa93-3a5b-4550-abe2-f9b28ab62544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15abcfb1-0303-4e9b-a938-74f0f58dad07 tempest-VolumesTransfersV357Test-1276477172 None] Created volume successfully.
Jul 07 03:39:00 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" returned: 0 in 0.729s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "cinder-quobyte-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f" released by "delete_volume" :: held 1.666s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.quota [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Created reservations ['3b5a0612-af34-41ea-bddb-b438f007277c', 'e146b7ec-afca-4c44-aa8c-15fe254e0870', '5cd28eee-5b23-4d66-906a-c62c68012d0d', '8e23a658-8870-4fa8-a86f-b4848378c0a1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:00 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:00 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5f9a36-be60-483d-816b-25bb8a23506a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:01 devstack sudo[94320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed
Jul 07 03:39:01 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cac14125-0af4-4a5d-9402-80ae9b51186b tempest-VolumesTransfersV357Test-1823756620 None] Transfer volume completed successfully.
Jul 07 03:39:01 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.736s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG cinder.manager [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Deleted volume successfully.
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-79fa9b4d-4aa1-439b-acb5-4244c5e79e7d req-26d083e2-e225-4b55-a208-1e2309ef0cba tempest-VolumesGetTestJSON-1544490303 None] Lock "cinder-bbbcdfa9-e0f4-4ea9-96a2-b7483953c01f-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:01 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:01 devstack sudo[94326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed
Jul 07 03:39:01 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "cinder-49939852-f538-4035-a271-5aba0435a1a1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-49939852-f538-4035-a271-5aba0435a1a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "cinder-quobyte-49939852-f538-4035-a271-5aba0435a1a1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-quobyte-49939852-f538-4035-a271-5aba0435a1a1" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b043400-16b5-49a6-bc06-9887178ea0fb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:02 devstack sudo[94329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1
Jul 07 03:39:02 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:02 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-70ec031e-4f8e-4b22-8af0-52aabe863fed" returned: 0 in 0.872s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Lock "cinder-quobyte-70ec031e-4f8e-4b22-8af0-52aabe863fed" released by "delete_volume" :: held 1.794s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['95d57aea-ec1d-4076-98a6-1dea70662af4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:02 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1320165266 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1320165266, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:39:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Created reservations ['777eb923-cf33-4189-b0e9-4d9cd683f3b7', 'b04fa6fc-9cb0-4b24-9d06-c165aa398ca2', 'fb29431a-f6ed-46e3-9406-b26422746ebe', 'f8d070f1-a89e-4c49-a469-89d7b4ff1d45'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:03 devstack sudo[94333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:03 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:03 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1" returned: 0 in 1.107s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:03 devstack sudo[94338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1
Jul 07 03:39:03 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:04 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.030s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e55328eb-46cc-41ff-9d9f-77fb5a5e22d5 tempest-GroupSnapshotsTest-668071879 None] Delete group completed successfully.
Jul 07 03:39:04 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-49939852-f538-4035-a271-5aba0435a1a1" returned: 0 in 0.891s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-quobyte-49939852-f538-4035-a271-5aba0435a1a1" released by "delete_volume" :: held 2.067s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Created reservations ['aed805f7-93b3-4b12-a2ac-a879acaaee8b', '722ce1eb-cbfb-41a8-83ce-2cb33f6bfd2f', 'fa486e5e-0370-404e-84d5-2544aebcc3ce', '783585a1-6c0c-43bc-92a1-001b28f1689d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:04 devstack sudo[94342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:04 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:05 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.886s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:05 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Deleted volume successfully.
Jul 07 03:39:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e45d83a7-480c-4980-a52e-1c2dd0bf70b0 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-49939852-f538-4035-a271-5aba0435a1a1-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Flow 'volume_create_manager' (c573a960-0a2b-45a1-894d-729f4953cc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085acd95-6483-47d3-8933-52a969a58271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (085acd95-6483-47d3-8933-52a969a58271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-245938040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebef76d1-2f3c-4ffd-8c80-1be2c3720361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef79119fc84ff9bc739b31f5626370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:07Z,use_quota=True,user_id='f51752ee248540248f4bb943d88a224e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dbd8ba-576b-47de-9ace-bf6a7c0663e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02dbd8ba-576b-47de-9ace-bf6a7c0663e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448b2574-6fcf-49b4-a418-c4f83752d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448b2574-6fcf-49b4-a418-c4f83752d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebef76d1-2f3c-4ffd-8c80-1be2c3720361', 'volume_name': 'volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4830eec-93a5-4889-894c-9fd48295c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4830eec-93a5-4889-894c-9fd48295c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ed4983-2ca8-4e81-9a84-35e9e9890c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Volume ebef76d1-2f3c-4ffd-8c80-1be2c3720361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361', 'volume_size': 1}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-245938040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebef76d1-2f3c-4ffd-8c80-1be2c3720361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ef79119fc84ff9bc739b31f5626370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:07Z,use_quota=True,user_id='f51752ee248540248f4bb943d88a224e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Creating volume ebef76d1-2f3c-4ffd-8c80-1be2c3720361 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:06 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:06 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 1073741824
Jul 07 03:39:06 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (283e770d-5b95-4a15-abfa-e4af4f182017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130cbc17-9dda-4dc4-8946-2195e206c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130cbc17-9dda-4dc4-8946-2195e206c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647314789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ad5690-51f6-46d7-a526-b330ca25c3be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:07Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe75f556-c5f2-4c50-86a4-2860e9f7eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe75f556-c5f2-4c50-86a4-2860e9f7eab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f9ee01-62c6-41c3-8147-222fc59bb9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f9ee01-62c6-41c3-8147-222fc59bb9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ad5690-51f6-46d7-a526-b330ca25c3be', 'volume_name': 'volume-58ad5690-51f6-46d7-a526-b330ca25c3be', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cc1d4d-a43f-4912-b8aa-0df265f3fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cc1d4d-a43f-4912-b8aa-0df265f3fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f820a97a-c7f3-4ce8-8918-327d5575a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Volume 58ad5690-51f6-46d7-a526-b330ca25c3be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ad5690-51f6-46d7-a526-b330ca25c3be', 'volume_size': 1}
Jul 07 03:39:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:07 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 1073741824" returned: 0 in 0.930s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:07 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361
Jul 07 03:39:07 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:08 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" returned: 0 in 0.693s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-647314789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ad5690-51f6-46d7-a526-b330ca25c3be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:07Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Creating volume 58ad5690-51f6-46d7-a526-b330ca25c3be {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:08 devstack sudo[94372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be 1073741824
Jul 07 03:39:08 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ed4983-2ca8-4e81-9a84-35e9e9890c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f90fe4-b9e9-4de2-875f-5571d3223abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Volume volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 (ebef76d1-2f3c-4ffd-8c80-1be2c3720361): created successfully
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9f90fe4-b9e9-4de2-875f-5571d3223abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Flow 'volume_create_manager' (c573a960-0a2b-45a1-894d-729f4953cc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1de420df-ae62-42e1-a1b0-bc33e9d24c69 tempest-VolumesTransfersV357Test-1276477172 None] Created volume successfully.
Jul 07 03:39:09 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be 1073741824" returned: 0 in 1.102s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:09 devstack sudo[94397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be
Jul 07 03:39:09 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91a689e2-19d2-4e67-93fa-4f6d5f051de4 tempest-GroupsV314Test-1398361184 None] Group tempest-GroupsV314Test-Group-1346976290: creating
Jul 07 03:39:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91a689e2-19d2-4e67-93fa-4f6d5f051de4 tempest-GroupsV314Test-1398361184 None] Group tempest-GroupsV314Test-Group-1346976290: created successfully
Jul 07 03:39:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91a689e2-19d2-4e67-93fa-4f6d5f051de4 tempest-GroupsV314Test-1398361184 None] Create group completed successfully.
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "cinder-ebef76d1-2f3c-4ffd-8c80-1be2c3720361-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-ebef76d1-2f3c-4ffd-8c80-1be2c3720361-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "cinder-quobyte-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-quobyte-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe5791-0a88-44c8-bfd3-40b0489d8047]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:10 devstack sudo[94400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361
Jul 07 03:39:10 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:10 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be" returned: 0 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f820a97a-c7f3-4ce8-8918-327d5575a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ad5690-51f6-46d7-a526-b330ca25c3be', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215b6e0-feb4-4fc6-ae70-4505d83e8618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Volume volume-58ad5690-51f6-46d7-a526-b330ca25c3be (58ad5690-51f6-46d7-a526-b330ca25c3be): created successfully
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3215b6e0-feb4-4fc6-ae70-4505d83e8618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (283e770d-5b95-4a15-abfa-e4af4f182017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-07e0eed4-24f7-4683-90fa-73c14ca76005 tempest-VolumesTestJSON-991627247 None] Created volume successfully.
Jul 07 03:39:11 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:11 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361
Jul 07 03:39:11 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (85113dce-72a5-4dbc-9bc0-6c54c502371c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d10c7-2d49-419d-bf43-96701d9b02a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0d10c7-2d49-419d-bf43-96701d9b02a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446827282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde88c03-7c46-41a9-b151-a7b3ebf4a07a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:12Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ee6708-ae06-46a4-800f-16523b0f4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ee6708-ae06-46a4-800f-16523b0f4855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cda79e-9e3e-4e0f-9f0e-451a0037a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cda79e-9e3e-4e0f-9f0e-451a0037a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde88c03-7c46-41a9-b151-a7b3ebf4a07a', 'volume_name': 'volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c899cf-91ab-49ec-8806-438afa476175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c899cf-91ab-49ec-8806-438afa476175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30240df-ae89-4c7c-9893-476c5f43fe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:11 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Volume bde88c03-7c46-41a9-b151-a7b3ebf4a07a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a', 'volume_size': 1}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1446827282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde88c03-7c46-41a9-b151-a7b3ebf4a07a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:12Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Creating volume bde88c03-7c46-41a9-b151-a7b3ebf4a07a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:11 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:11 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a 1073741824
Jul 07 03:39:11 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:12 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" returned: 0 in 0.885s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-quobyte-ebef76d1-2f3c-4ffd-8c80-1be2c3720361" released by "delete_volume" :: held 1.791s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Flow 'volume_create_manager' (bd022bd8-c935-412b-a50d-e08d17393612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7444995-1717-4eb0-9694-e1fe26cc95cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7444995-1717-4eb0-9694-e1fe26cc95cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255789505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e2fbc9c-8538-4b0c-97c3-eb6401b32dbd,host='devstack@QuobyteHD#QuobyteHD',id=299ee5cd-5843-4acf-b4d9-755467a1f1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12020b9ad97b4973b592bc0bf6a738b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:12Z,use_quota=True,user_id='4529b834112a4844af570d7e6e96ef3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9488b56-725b-4706-abc9-1f2bed3ef99c),volume_type_id=b9488b56-725b-4706-abc9-1f2bed3ef99c)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229e2c5-47bc-482e-9888-b9d6d4c8dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8229e2c5-47bc-482e-9888-b9d6d4c8dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36550bc5-561c-45a7-afb0-58827ba96b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36550bc5-561c-45a7-afb0-58827ba96b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299ee5cd-5843-4acf-b4d9-755467a1f1ad', 'volume_name': 'volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036dea3-ec2d-4c62-a249-a3744445b8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1036dea3-ec2d-4c62-a249-a3744445b8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e87957-e6a7-4555-a962-99d7f00eb644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Volume 299ee5cd-5843-4acf-b4d9-755467a1f1ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad', 'volume_size': 1}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Created reservations ['9d9c6e5a-5d91-477b-995d-be8340b77fc0', 'e5d6c285-1689-4b08-8a3f-948492db2fba', '536059ee-acbc-4764-bbb3-f5fc7fbc5f7d', '41f3e409-d247-494f-b648-65a34d2eac01'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:12 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:12 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:12 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a 1073741824" returned: 0 in 1.188s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:13 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a
Jul 07 03:39:13 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:13 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.022s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Deleted volume successfully.
Jul 07 03:39:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-911bcc8d-9ee3-4265-b403-a173d279f0a7 tempest-VolumesTransfersV357Test-1997498889 None] Lock "cinder-ebef76d1-2f3c-4ffd-8c80-1be2c3720361-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:14 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" returned: 0 in 1.036s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e2fbc9c-8538-4b0c-97c3-eb6401b32dbd,created_at=2026-07-07T01:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255789505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e2fbc9c-8538-4b0c-97c3-eb6401b32dbd,host='devstack@QuobyteHD#QuobyteHD',id=299ee5cd-5843-4acf-b4d9-755467a1f1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12020b9ad97b4973b592bc0bf6a738b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:12Z,use_quota=True,user_id='4529b834112a4844af570d7e6e96ef3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9488b56-725b-4706-abc9-1f2bed3ef99c),volume_type_id=b9488b56-725b-4706-abc9-1f2bed3ef99c)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Creating volume 299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30240df-ae89-4c7c-9893-476c5f43fe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:14 devstack sudo[94466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad 1073741824
Jul 07 03:39:14 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96fa210-3517-42f5-8591-2e48794bab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Volume volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a (bde88c03-7c46-41a9-b151-a7b3ebf4a07a): created successfully
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96fa210-3517-42f5-8591-2e48794bab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (85113dce-72a5-4dbc-9bc0-6c54c502371c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f6ae1497-3178-4609-bace-3b5fa155b285 tempest-VolumesTestJSON-991627247 None] Created volume successfully.
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:15 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:15 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:15 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad 1073741824" returned: 0 in 1.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:15 devstack sudo[94475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:15 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (107b8967-986d-44a8-9edc-b748979d176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c81e8d-ef22-4892-8b85-967086e7d7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02c81e8d-ef22-4892-8b85-967086e7d7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851324487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eeacba-a6ce-4369-8fbb-3a37c2073121,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:16Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef8ffd9-1e45-4808-a4fd-6ac19e86333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef8ffd9-1e45-4808-a4fd-6ac19e86333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bfe00-e904-48d4-a3d2-70f4f5d24b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866bfe00-e904-48d4-a3d2-70f4f5d24b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29eeacba-a6ce-4369-8fbb-3a37c2073121', 'volume_name': 'volume-29eeacba-a6ce-4369-8fbb-3a37c2073121', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b4900-b759-454a-906e-902729b95576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5b4900-b759-454a-906e-902729b95576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b07d22-0347-4bed-b9a7-69930781fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Volume 29eeacba-a6ce-4369-8fbb-3a37c2073121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29eeacba-a6ce-4369-8fbb-3a37c2073121', 'volume_size': 1}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.344s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 8 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:39:16 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.965s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.673s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.052s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851324487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eeacba-a6ce-4369-8fbb-3a37c2073121,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ae980508b61f4f13b63adf1b96260127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:16Z,use_quota=True,user_id='b7814e1b26284f258714ca760bd90c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Creating volume 29eeacba-a6ce-4369-8fbb-3a37c2073121 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e87957-e6a7-4555-a962-99d7f00eb644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc9fa4-4b5f-4b5d-87eb-4b5099f1a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:16 devstack sudo[94480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 1073741824
Jul 07 03:39:16 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Volume volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad (299ee5cd-5843-4acf-b4d9-755467a1f1ad): created successfully
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42bc9fa4-4b5f-4b5d-87eb-4b5099f1a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Flow 'volume_create_manager' (bd022bd8-c935-412b-a50d-e08d17393612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fb730f3a-931a-4de3-87e5-25a6d38a5eed tempest-GroupsV314Test-1398361184 None] Created volume successfully.
Jul 07 03:39:17 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 1073741824" returned: 0 in 1.210s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:18 devstack sudo[94485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121
Jul 07 03:39:18 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:18 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b07d22-0347-4bed-b9a7-69930781fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29eeacba-a6ce-4369-8fbb-3a37c2073121', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78335c6a-8f24-4ac4-9051-41aae3fc030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Volume volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 (29eeacba-a6ce-4369-8fbb-3a37c2073121): created successfully
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78335c6a-8f24-4ac4-9051-41aae3fc030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Flow 'volume_create_manager' (107b8967-986d-44a8-9edc-b748979d176e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-37aab293-41b6-46a3-b98c-9fdf929bc269 tempest-VolumesTestJSON-991627247 None] Created volume successfully.
Jul 07 03:39:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:19 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Cloning volume 299ee5cd-5843-4acf-b4d9-755467a1f1ad to volume 5c898622-3a3f-4041-8788-e2cbb9cc8cbb
Jul 07 03:39:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Creating offline snapshot f690df1a-9be5-4cfa-a391-6849d3c41472 of volume 299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:39:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36d4761-4643-433f-9a86-22228bb35bbd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:19 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:19 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:20 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.964s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:20 devstack sudo[94495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 1G
Jul 07 03:39:20 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Flow 'volume_create_manager' (e8332daa-a739-44d6-a0d0-27d0553219c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5692302f-1ab9-46c0-9530-a0c3ba927218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-29eeacba-a6ce-4369-8fbb-3a37c2073121-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5692302f-1ab9-46c0-9530-a0c3ba927218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-624004957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a81db-362c-445c-93ac-d462dd6e878b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672b5757ad8c4472a859790cd9b9d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:21Z,use_quota=True,user_id='57235de4b60343efa4fca33549954e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a3eaa5-2549-428b-a32f-ef41e572d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a3eaa5-2549-428b-a32f-ef41e572d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdf7a9-4b42-4bee-bfc7-67922eb76057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9fdf7a9-4b42-4bee-bfc7-67922eb76057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1a81db-362c-445c-93ac-d462dd6e878b', 'volume_name': 'volume-ed1a81db-362c-445c-93ac-d462dd6e878b', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e7f125-46c8-4c97-b539-df821621679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e7f125-46c8-4c97-b539-df821621679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bb76aa-e43a-4c8d-8f6e-47a6f70d2cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Volume ed1a81db-362c-445c-93ac-d462dd6e878b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1a81db-362c-445c-93ac-d462dd6e878b', 'volume_size': 2}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "cinder-29eeacba-a6ce-4369-8fbb-3a37c2073121-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-quobyte-29eeacba-a6ce-4369-8fbb-3a37c2073121" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-29eeacba-a6ce-4369-8fbb-3a37c2073121" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9735e-69e3-4f68-a6cd-db2b280bac5d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:21 devstack sudo[94502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121
Jul 07 03:39:21 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:21 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 1G" returned: 0 in 1.160s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:21 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:21 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:21 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:21 devstack sudo[94512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121
Jul 07 03:39:21 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:21 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:21 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:39:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:22 devstack sudo[94514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:22 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:22 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29eeacba-a6ce-4369-8fbb-3a37c2073121" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-29eeacba-a6ce-4369-8fbb-3a37c2073121" released by "delete_volume" :: held 1.625s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:22 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Created reservations ['fa96d814-513e-4c7c-aa81-a85a7887d996', '9fba0d30-2a52-43b5-8b69-b7c7b3f57560', '27c0b0c1-19d1-468d-a889-965888f2045f', 'fa841613-cb24-48f4-a2da-1cd0a2e7ffa5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:22 devstack sudo[94518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info
Jul 07 03:39:22 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:22 devstack sudo[94520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:22 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-bde88c03-7c46-41a9-b151-a7b3ebf4a07a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "cinder-bde88c03-7c46-41a9-b151-a7b3ebf4a07a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-quobyte-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[78359603-d570-454e-b8d0-9faa26d82b31]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:23 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:23 devstack sudo[94525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info
Jul 07 03:39:23 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a
Jul 07 03:39:23 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:23 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:23 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.810s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Deleted volume successfully.
Jul 07 03:39:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f7133618-8a07-4ae1-9129-a15760ba544a tempest-VolumesTestJSON-991627247 None] Lock "cinder-29eeacba-a6ce-4369-8fbb-3a37c2073121-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:24 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.info" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Acquiring lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] snapshot: f690df1a-9be5-4cfa-a391-6849d3c41472, volume: 5c898622-3a3f-4041-8788-e2cbb9cc8cbb,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a241b2-a6c2-4b31-bbc1-6a33c81b3013]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:24 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" returned: 0 in 0.889s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:24 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a
Jul 07 03:39:24 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:24 devstack sudo[94532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:24 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:25 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-bde88c03-7c46-41a9-b151-a7b3ebf4a07a" released by "delete_volume" :: held 1.654s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Created reservations ['5d00f8c8-2dc9-418a-ae9b-03c59012f4c2', 'ea0c3609-73ce-4259-91e4-442b12396a44', '25cdfc05-42a5-4800-8107-1d1c59d03177', '70ae094e-32f5-4729-885c-4957d1ad5145'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:25 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.854s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24a7e67-c390-47f0-ba5b-26ad1ec66745]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:25 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:25 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:25 devstack sudo[94563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:25 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-58ad5690-51f6-46d7-a526-b330ca25c3be-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "cinder-58ad5690-51f6-46d7-a526-b330ca25c3be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Acquiring lock "cinder-quobyte-58ad5690-51f6-46d7-a526-b330ca25c3be" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-58ad5690-51f6-46d7-a526-b330ca25c3be" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59efc03-8638-4728-bfdb-d55ce04bd9a3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:25 devstack sudo[94567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be
Jul 07 03:39:25 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:25 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.662s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Deleted volume successfully.
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3aca36e6-06c7-4395-b7bd-6c0840327508 tempest-VolumesTestJSON-991627247 None] Lock "cinder-bde88c03-7c46-41a9-b151-a7b3ebf4a07a-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:25 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.806s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:39:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:26 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb
Jul 07 03:39:26 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:26 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:26 devstack sudo[94579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be
Jul 07 03:39:26 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:27 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-58ad5690-51f6-46d7-a526-b330ca25c3be" returned: 0 in 1.072s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "cinder-quobyte-58ad5690-51f6-46d7-a526-b330ca25c3be" released by "delete_volume" :: held 1.920s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=173,cinder:SELECT=132,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Created reservations ['d4657964-1aff-413c-a47d-e441458f8273', 'a1bf9a7b-90f2-4f57-84fb-eee3ea839388', 'c46850a5-3b65-4c0d-9b2f-eb1716717be2', 'c8faedd2-3b79-467d-b292-f6d330739cc5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:28 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:28 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:29 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 2.029s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Deleted volume successfully.
Jul 07 03:39:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-18a05c9d-c019-4d04-8a3c-d693587d18e3 tempest-VolumesTestJSON-991627247 None] Lock "cinder-58ad5690-51f6-46d7-a526-b330ca25c3be-delete_volume" released by "delete_volume" :: held 4.431s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:31 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" returned: 0 in 5.576s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e41fe2a-ac2b-4690-b1d7-85d304a600bf]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:31 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:31 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:32 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.980s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:32 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:39:32 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Converted 1024.00 MB image at 183.58 MB/s
Jul 07 03:39:32 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 03:39:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:32 devstack sudo[94602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb
Jul 07 03:39:32 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:33 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" released by "_copy_volume_from_snapshot" :: held 8.999s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Acquiring lock "cinder-quobyte-f690df1a-9be5-4cfa-a391-6849d3c41472" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-f690df1a-9be5-4cfa-a391-6849d3c41472" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Deleting offline snapshot f690df1a-9be5-4cfa-a391-6849d3c41472 of volume 299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] snapshot_file for this snap is: volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8b9695-24aa-49a2-81a4-a38b43310082]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:33 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:33 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:34 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[258e1747-7453-4c7c-b159-84bf499d06cb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:34 devstack sudo[94610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:34 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:34 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.793s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:34 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:34 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:35 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:35 devstack sudo[94621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472
Jul 07 03:39:35 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:36 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad.f690df1a-9be5-4cfa-a391-6849d3c41472" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-f690df1a-9be5-4cfa-a391-6849d3c41472" released by "_delete_snapshot" :: held 3.259s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=144,cinder:UPDATE=166,cinder:INSERT=38,cinder:DELETE=9 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.541s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.601s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-624004957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1a81db-362c-445c-93ac-d462dd6e878b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672b5757ad8c4472a859790cd9b9d1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:21Z,use_quota=True,user_id='57235de4b60343efa4fca33549954e1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Creating volume ed1a81db-362c-445c-93ac-d462dd6e878b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:36 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b 2147483648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:36 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b 2147483648
Jul 07 03:39:36 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-242463e0-0556-4e3a-9d25-4bfc6d1bea6f tempest-GroupsV314Test-1398361184 None] Create group from source-group-9e2fbc9c-8538-4b0c-97c3-eb6401b32dbd completed successfully.
Jul 07 03:39:37 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b 2147483648" returned: 0 in 0.971s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:37 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b
Jul 07 03:39:37 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Acquiring lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd565e-e130-4338-a693-ad73e3cec180]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:38 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b" returned: 0 in 0.940s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bb76aa-e43a-4c8d-8f6e-47a6f70d2cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1a81db-362c-445c-93ac-d462dd6e878b', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5d5c60-2021-473b-b628-ff9e2509b5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Volume volume-ed1a81db-362c-445c-93ac-d462dd6e878b (ed1a81db-362c-445c-93ac-d462dd6e878b): created successfully
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5d5c60-2021-473b-b628-ff9e2509b5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Flow 'volume_create_manager' (e8332daa-a739-44d6-a0d0-27d0553219c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0246d6df-6311-4b47-8b6d-a994f347e8c2 tempest-VolumesCloneNegativeTest-1978500385 None] Created volume successfully.
Jul 07 03:39:38 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb
Jul 07 03:39:38 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:39 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" returned: 0 in 1.004s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:39 devstack sudo[94718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb
Jul 07 03:39:39 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Acquiring lock "cinder-ed1a81db-362c-445c-93ac-d462dd6e878b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "cinder-ed1a81db-362c-445c-93ac-d462dd6e878b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Acquiring lock "cinder-quobyte-ed1a81db-362c-445c-93ac-d462dd6e878b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "cinder-quobyte-ed1a81db-362c-445c-93ac-d462dd6e878b" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb34d2af-d80c-4ef6-ab2b-9fec2e4c49d2]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:40 devstack sudo[94721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b
Jul 07 03:39:40 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:40 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" returned: 0 in 0.905s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-5c898622-3a3f-4041-8788-e2cbb9cc8cbb" released by "delete_volume" :: held 1.993s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Created reservations ['3563323e-da77-43f9-a6ee-7874e7dd9127'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:40 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2042650766 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2042650766, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:39:40 devstack cinder-volume[86955]: WARNING cinder.quota [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2042650766 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2042650766, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Created reservations ['e7f989b6-f4d5-4220-ab63-95a107b25835', '8221ee8a-677d-4ebc-951f-c24778893148', '6b819f10-cbb7-434d-b904-0e75dbb8ea1a', '1b7d0786-dff9-4e94-8def-b34a2f71cc03'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:40 devstack sudo[94728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:40 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:40 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b" returned: 0 in 1.033s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:40 devstack sudo[94730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b
Jul 07 03:39:40 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Acquiring lock "cinder-quobyte-299ee5cd-5843-4acf-b4d9-755467a1f1ad" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-299ee5cd-5843-4acf-b4d9-755467a1f1ad" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e13ccd-1532-40f4-aa2c-8e4f5c7a6772]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:41 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5481fbf9-e471-4cd3-8765-e709f9b6bed2 tempest-GroupsV314Test-1398361184 None] Delete group completed successfully.
Jul 07 03:39:41 devstack sudo[94734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:41 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:41 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ed1a81db-362c-445c-93ac-d462dd6e878b" returned: 0 in 0.818s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "cinder-quobyte-ed1a81db-362c-445c-93ac-d462dd6e878b" released by "delete_volume" :: held 1.912s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Created reservations ['8a5cacf7-c0e0-49b9-be7e-fdb8ba8070e6', '586d0578-63a6-46d6-b24e-77b450deba45', 'b0d0d829-821e-4a4c-b505-cd2d66236fe0', 'b8cd6320-303e-427a-82db-e8b3d0d00b5c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:41 devstack sudo[94736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:41 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:42 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 1.058s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:42 devstack sudo[94742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad
Jul 07 03:39:42 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:42 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:42 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Deleted volume successfully.
Jul 07 03:39:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-001cc50c-909e-4d4e-875a-1f267f345286 tempest-VolumesCloneNegativeTest-1978500385 None] Lock "cinder-ed1a81db-362c-445c-93ac-d462dd6e878b-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:43 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-299ee5cd-5843-4acf-b4d9-755467a1f1ad" returned: 0 in 0.744s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Lock "cinder-quobyte-299ee5cd-5843-4acf-b4d9-755467a1f1ad" released by "delete_volume" :: held 1.904s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Created reservations ['ffb10f82-03d4-4403-8b4c-01014f672154'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Created reservations ['3f248413-eac4-4851-904b-071b89b416a4', 'e6f3ca5d-bcf3-4ff8-8a17-14946fea16d8', '8222ec36-cba3-41e1-8abe-0d241a3246eb', '84a16df1-b96d-4b93-a274-001f3829fc13'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:43 devstack sudo[94745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:43 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:44 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1f84826b-da15-4395-aa4a-b32d81098ecc tempest-GroupsV314Test-1398361184 None] Delete group completed successfully.
Jul 07 03:39:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-904bd5a0-30dd-49c0-9f3a-1ca1402aa33f req-3fd8d107-d97f-4f31-90c4-15699caa29bb tempest-AttachVolumeNegativeTest-1233159795 None] Terminate volume connection completed successfully.
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-904bd5a0-30dd-49c0-9f3a-1ca1402aa33f req-3fd8d107-d97f-4f31-90c4-15699caa29bb tempest-AttachVolumeNegativeTest-1233159795 None] Deleting attachment 1eecba3c-5a99-43bc-8ee9-9ded67018296. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Flow 'volume_create_manager' (49099450-a838-4a89-9e19-bfdd19d7ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fb0cc6-9ced-4d46-b676-17dbdc477335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fb0cc6-9ced-4d46-b676-17dbdc477335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1561080725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2296c3-de29-4cbc-ba69-6c14ea0a49bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6a506b611470f9d9be025ea0b1269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:47Z,use_quota=True,user_id='38866c36934340f68e80bc78592d4ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87826b3b-1053-424f-aa31-92e0aae6f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87826b3b-1053-424f-aa31-92e0aae6f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3bfa89-2c1d-4f87-9489-58c819d41136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Flow 'volume_create_manager' (a9bef29d-5e7e-446c-b907-773effe71f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eacf4e-dae2-419e-8d0d-eec3e5972546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04eacf4e-dae2-419e-8d0d-eec3e5972546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869037000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c87f073-1820-4256-8bf1-91c863c7e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d51fc8decec4568a8e36e201aae81cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:48Z,use_quota=True,user_id='5e54784d2e9a46ae86365010e7190480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99111b35-01cc-491e-8e55-8ee116f653b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99111b35-01cc-491e-8e55-8ee116f653b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc6cb5-40f9-4e3c-9804-7ba0ea9963eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc6cb5-40f9-4e3c-9804-7ba0ea9963eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c87f073-1820-4256-8bf1-91c863c7e2ea', 'volume_name': 'volume-3c87f073-1820-4256-8bf1-91c863c7e2ea', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caf19b7-4fd2-46c3-9f3a-f01aefe3ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caf19b7-4fd2-46c3-9f3a-f01aefe3ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5405f352-c0d3-44c3-8892-240ef0276f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume 3c87f073-1820-4256-8bf1-91c863c7e2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c87f073-1820-4256-8bf1-91c863c7e2ea', 'volume_size': 1}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869037000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c87f073-1820-4256-8bf1-91c863c7e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d51fc8decec4568a8e36e201aae81cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:48Z,use_quota=True,user_id='5e54784d2e9a46ae86365010e7190480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Creating volume 3c87f073-1820-4256-8bf1-91c863c7e2ea {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:47 devstack sudo[94752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea 1073741824
Jul 07 03:39:47 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3bfa89-2c1d-4f87-9489-58c819d41136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b2296c3-de29-4cbc-ba69-6c14ea0a49bc', 'volume_name': 'volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5da7e0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c973e4aa-d0f0-4461-be47-7bff1ed77f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c973e4aa-d0f0-4461-be47-7bff1ed77f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa25fddc-bde1-441a-aa65-07d8929adb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5da7e0>}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Trying to clone 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc from image bce35279-0f3f-4049-8975-1c6590eb177b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:39:48 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 03:39:48 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea 1073741824" returned: 0 in 1.099s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5e5524-65a1-4b35-a427-062b18c4b3ff]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:49 devstack sudo[94783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea
Jul 07 03:39:49 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:49 devstack sudo[94782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD
Jul 07 03:39:49 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:49 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea" returned: 0 in 0.882s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5405f352-c0d3-44c3-8892-240ef0276f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c87f073-1820-4256-8bf1-91c863c7e2ea', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe38a86-ca2b-49e2-a24f-4b0f28f9a928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume volume-3c87f073-1820-4256-8bf1-91c863c7e2ea (3c87f073-1820-4256-8bf1-91c863c7e2ea): created successfully
Jul 07 03:39:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe38a86-ca2b-49e2-a24f-4b0f28f9a928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Flow 'volume_create_manager' (a9bef29d-5e7e-446c-b907-773effe71f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-31a4e968-8ce0-4f59-8d44-c6543843013e tempest-VolumeQuotasAdminTestJSON-1659864174 None] Created volume successfully.
Jul 07 03:39:50 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD" returned: 0 in 1.044s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b is fetched for user 38866c36934340f68e80bc78592d4ae2. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[09598887-8f05-40f5-b291-18306fd276d2]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:50 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD
Jul 07 03:39:50 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Flow 'volume_create_manager' (ce5ce27f-5651-4575-afc9-0dce79b3245f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a2ecea-c6be-4a71-b1af-11809f75ecf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a2ecea-c6be-4a71-b1af-11809f75ecf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1343404912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78464fd-3840-4de6-8621-f463530a4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0d53a790e048899d219f55a896401b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:50Z,use_quota=True,user_id='24c38684d36c4d88963607b3fd5fd1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32230e5c-152d-4686-8a78-dd197a7296f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32230e5c-152d-4686-8a78-dd197a7296f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea02ea3-43e1-44b2-81b6-0e633f264a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ea02ea3-43e1-44b2-81b6-0e633f264a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78464fd-3840-4de6-8621-f463530a4223', 'volume_name': 'volume-b78464fd-3840-4de6-8621-f463530a4223', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8715cd2e-5ea4-46f6-8362-06a5325e3dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8715cd2e-5ea4-46f6-8362-06a5325e3dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3606f3c2-843d-417e-b79a-ae08b823ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Volume b78464fd-3840-4de6-8621-f463530a4223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78464fd-3840-4de6-8621-f463530a4223', 'volume_size': 1}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1343404912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78464fd-3840-4de6-8621-f463530a4223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0d53a790e048899d219f55a896401b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:50Z,use_quota=True,user_id='24c38684d36c4d88963607b3fd5fd1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Creating volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:50 devstack sudo[94804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 1073741824
Jul 07 03:39:50 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:50 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "cinder-3c87f073-1820-4256-8bf1-91c863c7e2ea-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "cinder-3c87f073-1820-4256-8bf1-91c863c7e2ea-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "cinder-quobyte-3c87f073-1820-4256-8bf1-91c863c7e2ea" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "cinder-quobyte-3c87f073-1820-4256-8bf1-91c863c7e2ea" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[db803bf5-b64a-4195-afbc-4ebfdab30810]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:51 devstack sudo[94827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea
Jul 07 03:39:51 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:51 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 1073741824" returned: 0 in 1.160s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:51 devstack sudo[94834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223
Jul 07 03:39:51 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:52 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea" returned: 0 in 0.922s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:52 devstack sudo[94840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea
Jul 07 03:39:52 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:52 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1561080725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2296c3-de29-4cbc-ba69-6c14ea0a49bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6a506b611470f9d9be025ea0b1269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:47Z,use_quota=True,user_id='38866c36934340f68e80bc78592d4ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Creating volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:52 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3606f3c2-843d-417e-b79a-ae08b823ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78464fd-3840-4de6-8621-f463530a4223', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a90ea0-a23a-4d49-b2b3-52cc7509c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:52 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1073741824
Jul 07 03:39:52 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:52 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Volume volume-b78464fd-3840-4de6-8621-f463530a4223 (b78464fd-3840-4de6-8621-f463530a4223): created successfully
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a90ea0-a23a-4d49-b2b3-52cc7509c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Flow 'volume_create_manager' (ce5ce27f-5651-4575-afc9-0dce79b3245f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-84fc0138-b6bc-4fd3-9288-1c2ac5d63ce8 tempest-SnapshotsActionsTest-1765067522 None] Created volume successfully.
Jul 07 03:39:52 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3c87f073-1820-4256-8bf1-91c863c7e2ea" returned: 0 in 0.738s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "cinder-quobyte-3c87f073-1820-4256-8bf1-91c863c7e2ea" released by "delete_volume" :: held 1.716s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:52 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Created reservations ['2f64f29f-303b-46a3-8640-881a2c30f112', '06797535-bd96-4925-acdf-16274576cdd8', 'adb6faf1-7ea7-4b1d-9dc6-7ca629a2c4a4', '6cab5d83-a325-4c73-8886-470b48dae350'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:53 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:39:53 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:53 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1073741824" returned: 0 in 1.008s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:53 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:39:53 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:53 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:39:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Deleted volume successfully.
Jul 07 03:39:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2cf233ad-bd38-4c12-937f-a20a95c95daf tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "cinder-3c87f073-1820-4256-8bf1-91c863c7e2ea-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Flow 'volume_create_manager' (1c25a85a-582f-4e33-9392-bc9190b84e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5b6a8a-3f3c-4a17-933c-ebe94d8b17b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5b6a8a-3f3c-4a17-933c-ebe94d8b17b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-513017365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee006283-adbb-457e-811e-d4ab7ee43374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d51fc8decec4568a8e36e201aae81cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:54Z,use_quota=True,user_id='5e54784d2e9a46ae86365010e7190480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962fc364-d6da-46c1-ba66-a93412838163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962fc364-d6da-46c1-ba66-a93412838163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc86fdd2-134b-4a8b-83e5-5c17b0ec59f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc86fdd2-134b-4a8b-83e5-5c17b0ec59f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee006283-adbb-457e-811e-d4ab7ee43374', 'volume_name': 'volume-ee006283-adbb-457e-811e-d4ab7ee43374', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd853797-e777-481c-92c8-705939f3ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd853797-e777-481c-92c8-705939f3ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c021f95-169a-4649-af0f-8be9359d8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:39:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume ee006283-adbb-457e-811e-d4ab7ee43374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee006283-adbb-457e-811e-d4ab7ee43374', 'volume_size': 1}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:54 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 0.830s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.200s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Creating offline snapshot ac953671-25c8-4f7f-b94c-aa1680e44474 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd80ea21-4da1-4acf-842e-ac0d03d88b92]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Attempting download of bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[965517c6-4f22-41b8-a6d5-0efaf3f2a428]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:54 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223
Jul 07 03:39:54 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:54 devstack sudo[94867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b
Jul 07 03:39:54 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:55 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223" returned: 0 in 0.781s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:55 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:55 devstack sudo[94875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 1G
Jul 07 03:39:55 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:55 devstack sudo[94876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b
Jul 07 03:39:55 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:56 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b" returned: 1 in 0.799s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_e5fyam5b' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c30df7-acd6-4160-beb4-a61ead49ff8e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:56 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 1G" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:56 devstack sudo[94886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:39:56 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:56 devstack sudo[94885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD
Jul 07 03:39:56 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:56 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] bce35279-0f3f-4049-8975-1c6590eb177b was qcow2, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:56 devstack sudo[94897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:39:56 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:56 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.912s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:56 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 is being set with open permissions: ugo+rw
Jul 07 03:39:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:57 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:39:57 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:57 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.743s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:57 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info
Jul 07 03:39:57 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:58 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info" returned: 0 in 0.817s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info is being set with open permissions: ugo+rw
Jul 07 03:39:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:58 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info
Jul 07 03:39:58 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:59 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 2.346s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_latd6ijhdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:39:59 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Converted 112.00 MB image at 47.70 MB/s
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:59 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.info" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:39:59 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1G
Jul 07 03:39:59 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.932s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.025s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-513017365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee006283-adbb-457e-811e-d4ab7ee43374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d51fc8decec4568a8e36e201aae81cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:39:54Z,use_quota=True,user_id='5e54784d2e9a46ae86365010e7190480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Creating volume ee006283-adbb-457e-811e-d4ab7ee43374 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:39:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:39:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:39:59 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 1073741824
Jul 07 03:39:59 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:39:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e167899a-2e57-457b-9cd6-115ed53c4adb tempest-SnapshotsActionsTest-1765067522 None] Create snapshot completed successfully
Jul 07 03:40:00 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 1G" returned: 0 in 0.745s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a6fcbd-7153-4855-86a3-1ca79b33c1e0]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:00 devstack sudo[94932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:00 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:00 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 1073741824" returned: 0 in 0.971s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:00 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374
Jul 07 03:40:00 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:00 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 0.945s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:01 devstack sudo[94942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:01 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:01 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.417s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Creating offline snapshot 5ef6638c-7f35-43f6-b444-77bb1e3f8f56 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c021f95-169a-4649-af0f-8be9359d8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee006283-adbb-457e-811e-d4ab7ee43374', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06409e69-e4af-486c-8fef-717c9962cd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0dab03-31cb-462b-9649-17c339e23365]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Volume volume-ee006283-adbb-457e-811e-d4ab7ee43374 (ee006283-adbb-457e-811e-d4ab7ee43374): created successfully
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06409e69-e4af-486c-8fef-717c9962cd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Flow 'volume_create_manager' (1c25a85a-582f-4e33-9392-bc9190b84e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f9d2f00b-0c33-4e19-a495-e9ee43b45c13 tempest-VolumeQuotasAdminTestJSON-1659864174 None] Created volume successfully.
Jul 07 03:40:01 devstack sudo[94945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:01 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:01 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 1 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Downloaded image bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b for user 38866c36934340f68e80bc78592d4ae2 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Marking volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Copying metadata from image bce35279-0f3f-4049-8975-1c6590eb177b to 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Creating volume glance metadata for volume 5b2296c3-de29-4cbc-ba69-6c14ea0a49bc backed by image bce35279-0f3f-4049-8975-1c6590eb177b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa25fddc-bde1-441a-aa65-07d8929adb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5da7e0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c66456-7995-49c1-a2e9-c434004e154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Volume volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc (5b2296c3-de29-4cbc-ba69-6c14ea0a49bc): created successfully
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06c66456-7995-49c1-a2e9-c434004e154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Flow 'volume_create_manager' (49099450-a838-4a89-9e19-bfdd19d7ad02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-06b88a4b-801e-45aa-b398-dff1d49b3ecb tempest-VolumesExtendTest-197027138 None] Created volume successfully.
Jul 07 03:40:02 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.901s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:02 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 1G
Jul 07 03:40:02 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-77d03daf-82cd-42d0-a79f-7d1a9355a8f4 tempest-VolumeQuotasAdminTestJSON-878535182 None] Transfer volume completed successfully.
Jul 07 03:40:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:03 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 1G" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:03 devstack sudo[94961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56
Jul 07 03:40:03 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Acquiring lock "cinder-ee006283-adbb-457e-811e-d4ab7ee43374-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "cinder-ee006283-adbb-457e-811e-d4ab7ee43374-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Acquiring lock "cinder-quobyte-ee006283-adbb-457e-811e-d4ab7ee43374" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "cinder-quobyte-ee006283-adbb-457e-811e-d4ab7ee43374" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc18c4d-a4a9-44ab-a83f-f8c7d01181ce]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:03 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374
Jul 07 03:40:03 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:03 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 is being set with open permissions: ugo+rw
Jul 07 03:40:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:03 devstack sudo[94968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56
Jul 07 03:40:03 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:04 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374" returned: 0 in 0.799s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:04 devstack sudo[94973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374
Jul 07 03:40:04 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:04 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.329s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.105s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-26fffd04-8937-41be-8a83-dc19a79f2b5c tempest-SnapshotsActionsTest-1765067522 None] Create snapshot completed successfully
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035b18b-66be-4dcc-893a-cb2229d3be10]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:04 devstack sudo[94976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:04 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:04 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ee006283-adbb-457e-811e-d4ab7ee43374" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "cinder-quobyte-ee006283-adbb-457e-811e-d4ab7ee43374" released by "delete_volume" :: held 1.516s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Created reservations ['6e7b3be7-512d-4adc-9caf-63898cafb756', '6f3bb511-eacb-4d48-b4fe-4620d5b7b4ae', '0d22be4f-5708-4d22-978f-d39227242cb6', '757b0146-e2d4-4437-bcbf-479845f4bdfd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:04 devstack sudo[94979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:04 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-5ef6638c-7f35-43f6-b444-77bb1e3f8f56-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-5ef6638c-7f35-43f6-b444-77bb1e3f8f56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-5ef6638c-7f35-43f6-b444-77bb1e3f8f56" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-5ef6638c-7f35-43f6-b444-77bb1e3f8f56" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Deleting offline snapshot 5ef6638c-7f35-43f6-b444-77bb1e3f8f56 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] snapshot_file for this snap is: volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa319a95-8e85-4115-a1e3-bf0589b2c7bc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:05 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56
Jul 07 03:40:05 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:05 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:05 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:05 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:05 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.787s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Deleted volume successfully.
Jul 07 03:40:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-542bc085-efd3-4f05-a30b-2829458537f1 tempest-VolumeQuotasAdminTestJSON-166834811 None] Lock "cinder-ee006283-adbb-457e-811e-d4ab7ee43374-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:06 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 1 in 0.966s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:40:06 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56" returned: 0 in 1.133s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[137cea9a-ae8f-4543-9d5a-5d8c23e3f1c9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc 2G" returned: 0 in 0.121s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.915s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e86539a5-e55d-45dc-a544-e79b2832f538 tempest-VolumesExtendTest-197027138 None] Extend volume completed successfully.
Jul 07 03:40:06 devstack sudo[94997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:06 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "cinder-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-quobyte-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c799e-0aaa-4006-bb58-eae7164aa42b]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:07 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 1.088s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:07 devstack sudo[95004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56
Jul 07 03:40:07 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:07 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:07 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:08 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 1.138s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:08 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56" returned: 0 in 1.172s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:08 devstack sudo[95032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56
Jul 07 03:40:08 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:08 devstack sudo[95031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:08 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:09 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 1 in 0.870s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:09 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:09 devstack sudo[95040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.5ef6638c-7f35-43f6-b444-77bb1e3f8f56" returned: 0 in 0.801s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:09 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-5ef6638c-7f35-43f6-b444-77bb1e3f8f56" released by "_delete_snapshot" :: held 4.329s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_snapshot" :: held 4.353s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Created reservations ['c4de53ab-835d-4693-9f64-d7800999be1b', '6bad8f7d-fda2-44d1-afd3-acb13739442c', '0508a783-0483-4c8e-b0d6-82bdde452d0c', '847e7c5c-1c41-4da6-9239-8518c7018280'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Delete snapshot completed successfully.
Jul 07 03:40:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-112ce891-64eb-4711-96cc-72a97c4afedf tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-5ef6638c-7f35-43f6-b444-77bb1e3f8f56-delete_snapshot" released by "delete_snapshot" :: held 4.541s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:10 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc" released by "delete_volume" :: held 2.798s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Created reservations ['8a84566a-979a-4a1d-b179-cf23a22d4e50', '1dea987d-1180-44f0-8ad2-a4dafadd3b9d', '54a7d1d9-8ec0-4d13-b7fe-b2fde629f951', '821dfb9e-4338-45ca-9899-f8887664d6d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:10 devstack sudo[95043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:10 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Creating offline snapshot c30d81a8-94b1-4dc4-92aa-350ffc393a98 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b005c284-e5aa-4d2e-948a-22925b8739c2]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:11 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.066s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Deleted volume successfully.
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-006105c9-560c-4033-a81f-af05811f8a47 tempest-VolumesExtendTest-197027138 None] Lock "cinder-5b2296c3-de29-4cbc-ba69-6c14ea0a49bc-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:11 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:11 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Flow 'volume_create_manager' (d976cd95-9810-4062-89ac-32afad42e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0a460e-b4ef-42bd-b075-203e4d6a90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0a460e-b4ef-42bd-b075-203e4d6a90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1175827403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa362b7-a466-4274-bdbf-b9da586a62bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6a506b611470f9d9be025ea0b1269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:11Z,use_quota=True,user_id='38866c36934340f68e80bc78592d4ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdb9091-5fd4-4c9c-9828-737a4b426fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdb9091-5fd4-4c9c-9828-737a4b426fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d852b5d-36c3-499f-b548-1e1734254366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d852b5d-36c3-499f-b548-1e1734254366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa362b7-a466-4274-bdbf-b9da586a62bc', 'volume_name': 'volume-6aa362b7-a466-4274-bdbf-b9da586a62bc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e33b2d-200f-4b30-804b-52e99c2344cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e33b2d-200f-4b30-804b-52e99c2344cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d13ff6-649a-414c-93c4-3ea5b1b21de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:11 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Volume 6aa362b7-a466-4274-bdbf-b9da586a62bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa362b7-a466-4274-bdbf-b9da586a62bc', 'volume_size': 1}
Jul 07 03:40:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:12 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.906s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:12 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 1G
Jul 07 03:40:12 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:13 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 1G" returned: 0 in 1.168s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:13 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98
Jul 07 03:40:13 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:14 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98" returned: 0 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:14 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 is being set with open permissions: ugo+rw
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:14 devstack sudo[95131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98
Jul 07 03:40:14 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:14 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98" returned: 0 in 0.695s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.718s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1175827403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa362b7-a466-4274-bdbf-b9da586a62bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e6a506b611470f9d9be025ea0b1269',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:11Z,use_quota=True,user_id='38866c36934340f68e80bc78592d4ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Creating volume 6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:14 devstack sudo[95134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc 1073741824
Jul 07 03:40:14 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-78309ce4-e309-490c-b4c2-744dff1338e9 tempest-SnapshotsActionsTest-1765067522 None] Create snapshot completed successfully
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Flow 'volume_create_manager' (501b1641-9ad1-4cc7-a469-7fc6ea12e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f13d2e-37d9-42a5-8be2-fee867cc5d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f13d2e-37d9-42a5-8be2-fee867cc5d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2140142889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4424d642-4df9-4f7e-8b7c-07d21cb4f1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd87464858c34cd3a633a8783102575c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:15Z,use_quota=True,user_id='e40b2dc6643649229ace4ff018f9f3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b25021-2f59-4287-9027-a34c3c78ccd2),volume_type_id=d4b25021-2f59-4287-9027-a34c3c78ccd2)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:15 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:15 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251b607-cb68-414b-960b-0a32818e8b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7251b607-cb68-414b-960b-0a32818e8b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fac63c-0fd4-4e19-8317-26d2b9b4c665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fac63c-0fd4-4e19-8317-26d2b9b4c665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4424d642-4df9-4f7e-8b7c-07d21cb4f1c0', 'volume_name': 'volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb2a73-cfc2-4fa4-ba48-f025aa01b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb2a73-cfc2-4fa4-ba48-f025aa01b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd6bdbb-ddae-41ac-917a-458f29443649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Volume 4424d642-4df9-4f7e-8b7c-07d21cb4f1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0', 'volume_size': 1}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-c30d81a8-94b1-4dc4-92aa-350ffc393a98-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-c30d81a8-94b1-4dc4-92aa-350ffc393a98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-c30d81a8-94b1-4dc4-92aa-350ffc393a98" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-c30d81a8-94b1-4dc4-92aa-350ffc393a98" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Deleting offline snapshot c30d81a8-94b1-4dc4-92aa-350ffc393a98 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] snapshot_file for this snap is: volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bedee86-c55f-4d5f-9af1-0e6ba4504a82]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:15 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98
Jul 07 03:40:15 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:16 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc 1073741824" returned: 0 in 1.333s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:16 devstack sudo[95147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:16 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:16 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.980s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:40:16 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98" returned: 0 in 1.147s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6026cd-43ef-4087-9e9d-2ee8456fe47c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:17 devstack sudo[95153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:17 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:17 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 0.831s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.591s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2140142889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4424d642-4df9-4f7e-8b7c-07d21cb4f1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd87464858c34cd3a633a8783102575c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:15Z,use_quota=True,user_id='e40b2dc6643649229ace4ff018f9f3e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4b25021-2f59-4287-9027-a34c3c78ccd2),volume_type_id=d4b25021-2f59-4287-9027-a34c3c78ccd2)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Creating volume 4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:17 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:17 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 1073741824
Jul 07 03:40:17 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d13ff6-649a-414c-93c4-3ea5b1b21de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa362b7-a466-4274-bdbf-b9da586a62bc', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1ec3e7-ea4d-4d33-87f0-56820fbce2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Volume volume-6aa362b7-a466-4274-bdbf-b9da586a62bc (6aa362b7-a466-4274-bdbf-b9da586a62bc): created successfully
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1ec3e7-ea4d-4d33-87f0-56820fbce2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Flow 'volume_create_manager' (d976cd95-9810-4062-89ac-32afad42e291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5ddb637e-10b9-4f16-9d1b-942120d0aa36 tempest-VolumesExtendTest-197027138 None] Created volume successfully.
Jul 07 03:40:18 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 1.201s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:18 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98
Jul 07 03:40:18 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:18 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 1073741824" returned: 0 in 1.221s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:18 devstack sudo[95169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0
Jul 07 03:40:18 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:19 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98" returned: 0 in 0.986s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:19 devstack sudo[95177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98
Jul 07 03:40:19 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:19 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Creating offline snapshot 7317d5fd-c681-4945-b97c-509101c54431 of volume 6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cd6bdbb-ddae-41ac-917a-458f29443649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c4be63-ba83-45aa-a530-fab62fb75af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f81ee74-3e13-46bf-90cf-b169811bc341]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Volume volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 (4424d642-4df9-4f7e-8b7c-07d21cb4f1c0): created successfully
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c4be63-ba83-45aa-a530-fab62fb75af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Flow 'volume_create_manager' (501b1641-9ad1-4cc7-a469-7fc6ea12e13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-add06611-b997-4e5b-9108-ec5559b3f1d4 tempest-VolumeTypesAccessTest-1466423915 None] Created volume successfully.
Jul 07 03:40:19 devstack sudo[95179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:19 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Acquiring lock "cinder-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "cinder-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:19 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.c30d81a8-94b1-4dc4-92aa-350ffc393a98" returned: 0 in 0.913s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Acquiring lock "cinder-quobyte-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-c30d81a8-94b1-4dc4-92aa-350ffc393a98" released by "_delete_snapshot" :: held 4.383s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_snapshot" :: held 4.432s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "cinder-quobyte-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ba961-86ba-4f87-bed8-3b3f70e14593]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Created reservations ['12b44c5e-3152-4f07-b5be-2d6e73fb0862', 'db7b0b5d-1999-4e4a-92c5-c0a5e560b88c', '05c10d28-3f9b-40be-8fc7-e6168e86d77b', '35e55913-4e98-4708-b4be-9ce7f2a9605b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:20 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0
Jul 07 03:40:20 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Delete snapshot completed successfully.
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20c44c1b-70d1-4b36-9bac-57f699ceadc0 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-c30d81a8-94b1-4dc4-92aa-350ffc393a98-delete_snapshot" released by "delete_snapshot" :: held 4.689s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:20 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 1.102s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:20 devstack sudo[95187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 1G
Jul 07 03:40:20 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:20 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:20 devstack sudo[95201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0
Jul 07 03:40:20 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:21 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 1G" returned: 0 in 0.945s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa362b7-a466-4274-bdbf-b9da586a62bc -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:21 devstack sudo[95203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa362b7-a466-4274-bdbf-b9da586a62bc -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431
Jul 07 03:40:21 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:21 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "cinder-quobyte-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0" released by "delete_volume" :: held 1.709s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:21 devstack cinder-volume[86955]: WARNING cinder.quota [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2021932813 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2021932813, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:40:21 devstack cinder-volume[86955]: WARNING cinder.quota [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2021932813 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2021932813, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Created reservations ['dc6cc8a9-4909-4fe0-93fa-abcae4b14b7c', '38765027-3ec6-4bef-8c5a-654c2f38975f', '0eda9984-0929-4cc1-a83e-f84e3c0fcde2', 'ae429a20-abb3-46b5-bd90-6d67779de4f9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:21 devstack sudo[95209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:21 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:21 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa362b7-a466-4274-bdbf-b9da586a62bc -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:21 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 is being set with open permissions: ugo+rw
Jul 07 03:40:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:21 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431
Jul 07 03:40:21 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:22 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.793s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Deleted volume successfully.
Jul 07 03:40:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-12b05140-ee74-41bf-90ee-1c2717f15eff tempest-VolumeTypesAccessTest-1466423915 None] Lock "cinder-4424d642-4df9-4f7e-8b7c-07d21cb4f1c0-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:22 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:22 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info
Jul 07 03:40:22 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:23 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info is being set with open permissions: ugo+rw
Jul 07 03:40:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:23 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info
Jul 07 03:40:23 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:24 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.info" returned: 0 in 0.756s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.155s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.973s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Creating offline snapshot b82b40da-926f-4a34-afb7-696aec0e171e of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:40:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6c532825-a2fb-41f0-882b-cf7cf19198bf tempest-VolumesExtendTest-197027138 None] Create snapshot completed successfully
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaa1383-6a9c-4013-93ea-ea92ea008d74]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:24 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:24 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:25 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.948s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:25 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e 1G
Jul 07 03:40:25 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:26 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e 1G" returned: 0 in 0.947s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:26 devstack sudo[95231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e
Jul 07 03:40:26 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:27 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e" returned: 0 in 0.795s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e is being set with open permissions: ugo+rw
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:27 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e
Jul 07 03:40:27 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:27 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=115,cinder:SELECT=91,cinder:DELETE=8,cinder:INSERT=33 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.546s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.026s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e805ba-565a-4965-9b70-327a5a237451]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a04808e3-ce04-4bb3-95b8-7de46c5744e6 tempest-SnapshotsActionsTest-1765067522 None] Create snapshot completed successfully
Jul 07 03:40:27 devstack sudo[95261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:27 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:28 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 0.768s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-b82b40da-926f-4a34-afb7-696aec0e171e-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-b82b40da-926f-4a34-afb7-696aec0e171e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-b82b40da-926f-4a34-afb7-696aec0e171e" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 2G" returned: 0 in 0.198s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b82b40da-926f-4a34-afb7-696aec0e171e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Deleting offline snapshot b82b40da-926f-4a34-afb7-696aec0e171e of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] snapshot_file for this snap is: volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[39264029-a599-47ee-93fe-523a80142c23]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3e745661-2c94-4969-bacc-2dd7b17fd10f tempest-VolumesExtendTest-197027138 None] Extend volume completed successfully.
Jul 07 03:40:28 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e
Jul 07 03:40:28 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-7317d5fd-c681-4945-b97c-509101c54431-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-7317d5fd-c681-4945-b97c-509101c54431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-quobyte-7317d5fd-c681-4945-b97c-509101c54431" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-7317d5fd-c681-4945-b97c-509101c54431" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Deleting offline snapshot 7317d5fd-c681-4945-b97c-509101c54431 of volume 6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] snapshot_file for this snap is: volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb15ab-e693-4caf-9f4c-a81e7d587826]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:29 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431
Jul 07 03:40:29 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:29 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e" returned: 0 in 0.826s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd184c7-2fee-4d2a-b44d-10e870be57c9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:29 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:29 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:30 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431" returned: 0 in 0.842s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa362b7-a466-4274-bdbf-b9da586a62bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c2aba-349b-4f86-af5f-edeeb7123635]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:30 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:30 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:30 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:30 devstack sudo[95288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e
Jul 07 03:40:30 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:31 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 0.883s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:31 devstack sudo[95294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431
Jul 07 03:40:31 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:31 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e" returned: 0 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:31 devstack sudo[95300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e
Jul 07 03:40:31 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:32 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431" returned: 0 in 0.933s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:32 devstack sudo[95307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431
Jul 07 03:40:32 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:32 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.b82b40da-926f-4a34-afb7-696aec0e171e" returned: 0 in 0.752s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b82b40da-926f-4a34-afb7-696aec0e171e" released by "_delete_snapshot" :: held 3.403s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_snapshot" :: held 3.433s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Created reservations ['34241ac2-a286-4b2e-b83b-8865e7cd0f95', 'cc5003da-0aac-48ad-bef6-e77f67902c4f', 'd0807fbd-bd00-40f4-8cbb-edc9f941de0a', '49b6a91d-30bf-4df4-8af0-21a51ef3c330'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Delete snapshot completed successfully.
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4f3741e9-c31a-4d58-890d-2e8e0e8f5e69 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-b82b40da-926f-4a34-afb7-696aec0e171e-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:32 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc.7317d5fd-c681-4945-b97c-509101c54431" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-7317d5fd-c681-4945-b97c-509101c54431" released by "_delete_snapshot" :: held 3.475s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" released by "delete_snapshot" :: held 3.500s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Created reservations ['99c2c571-1eba-41f8-8747-8a957906762a', 'd1985a7a-fed0-4727-bf43-e9130977f256', '46c6bea8-5d1f-4d23-9d38-071e468ee817', '9e5240d0-9937-48d4-8066-ebedc321cf54'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Delete snapshot completed successfully.
Jul 07 03:40:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-379e9980-d038-4bde-8217-7370fdc7b1e7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-7317d5fd-c681-4945-b97c-509101c54431-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Creating offline snapshot 72dfa02f-bb5d-46dc-b40e-f269c8642413 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e7940-2f15-4eaa-8072-8b7f3f5a5d45]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:33 devstack sudo[95310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:33 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-6aa362b7-a466-4274-bdbf-b9da586a62bc-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-6aa362b7-a466-4274-bdbf-b9da586a62bc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d65e3-5e96-4c02-87a7-03360c945831]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:33 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:33 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:34 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.864s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:34 devstack sudo[95319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 1G
Jul 07 03:40:34 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:34 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 0.930s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:34 devstack sudo[95324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc
Jul 07 03:40:34 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (ef967e5a-97fd-435d-8622-aab49fde3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13742c9a-9d60-4a24-8d80-86bc9b9e37e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13742c9a-9d60-4a24-8d80-86bc9b9e37e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-470259756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4806b4d-bf5a-4e00-a365-6332321ba476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:35Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c04d3c-3d50-4628-85e9-5ec203ffe871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30c04d3c-3d50-4628-85e9-5ec203ffe871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e78daa1-07a8-4f39-b232-23d8c0955e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e78daa1-07a8-4f39-b232-23d8c0955e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4806b4d-bf5a-4e00-a365-6332321ba476', 'volume_name': 'volume-b4806b4d-bf5a-4e00-a365-6332321ba476', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a70bfc-f24a-4dad-a72e-be99bb28daea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a70bfc-f24a-4dad-a72e-be99bb28daea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be13550-2d51-4f4f-9d95-8fd0c9b54833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:35 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Volume b4806b4d-bf5a-4e00-a365-6332321ba476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4806b4d-bf5a-4e00-a365-6332321ba476', 'volume_size': 1}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:35 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 1G" returned: 0 in 1.009s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:35 devstack sudo[95330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413
Jul 07 03:40:35 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:35 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6aa362b7-a466-4274-bdbf-b9da586a62bc" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-quobyte-6aa362b7-a466-4274-bdbf-b9da586a62bc" released by "delete_volume" :: held 1.785s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Created reservations ['d34db9c5-2b6c-4543-a157-c31d98b44262', '8eecd8f5-5d02-4c46-bfa3-282c1ad6ba94', '8dad605e-bead-464e-b626-41b3c5f4972b', '0008affc-8ed6-41bf-af1a-c7b7d4621a21'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:35 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:35 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:36 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:36 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 is being set with open permissions: ugo+rw
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:36 devstack sudo[95338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413
Jul 07 03:40:36 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:36 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Deleted volume successfully.
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a82b13a4-7b1c-483a-8e42-3f362bae71f7 tempest-VolumesExtendTest-197027138 None] Lock "cinder-6aa362b7-a466-4274-bdbf-b9da586a62bc-delete_volume" released by "delete_volume" :: held 2.769s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:36 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413" returned: 0 in 0.799s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=112,cinder:UPDATE=131,cinder:DELETE=10,cinder:INSERT=34 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.589s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-470259756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4806b4d-bf5a-4e00-a365-6332321ba476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:35Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Creating volume b4806b4d-bf5a-4e00-a365-6332321ba476 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:36 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:36 devstack sudo[95342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 1073741824
Jul 07 03:40:36 devstack sudo[95342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1b163d59-a3ad-4157-90e3-6ec3d99544c7 tempest-SnapshotsActionsTest-1765067522 None] Create snapshot completed successfully
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-72dfa02f-bb5d-46dc-b40e-f269c8642413-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-72dfa02f-bb5d-46dc-b40e-f269c8642413-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Acquiring lock "cinder-quobyte-72dfa02f-bb5d-46dc-b40e-f269c8642413" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-72dfa02f-bb5d-46dc-b40e-f269c8642413" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Deleting offline snapshot 72dfa02f-bb5d-46dc-b40e-f269c8642413 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] snapshot_file for this snap is: volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77e6f5a-4c72-4f3b-a599-b84d67aed2db]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:37 devstack sudo[95383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413
Jul 07 03:40:37 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:38 devstack sudo[95342]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 1073741824" returned: 0 in 1.078s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:38 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476
Jul 07 03:40:38 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:38 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413" returned: 0 in 0.928s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:38 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[15086223-c21a-4c03-a98d-8fd5363d9ac0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476" returned: 0 in 0.769s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be13550-2d51-4f4f-9d95-8fd0c9b54833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4806b4d-bf5a-4e00-a365-6332321ba476', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0170dd99-07a1-4d4f-bf8a-c29ede3be7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Volume volume-b4806b4d-bf5a-4e00-a365-6332321ba476 (b4806b4d-bf5a-4e00-a365-6332321ba476): created successfully
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0170dd99-07a1-4d4f-bf8a-c29ede3be7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (ef967e5a-97fd-435d-8622-aab49fde3043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9d36f311-7b18-45a2-a073-5deb61a8eaf4 tempest-VolumesListAdminTestJSON-1443599385 None] Created volume successfully.
Jul 07 03:40:38 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:38 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (538623cc-61ae-4ffc-8296-739c1a2ded5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe50629-9686-4c57-bdbf-78339b1a1d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfe50629-9686-4c57-bdbf-78339b1a1d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1673988693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b894f1-7aec-4f05-851a-96b58cdaff16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:39Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ca3c6c-4c5f-4dd1-999c-0ba815378171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ca3c6c-4c5f-4dd1-999c-0ba815378171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a64cc1-1c77-4e54-b59a-aa651398d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a64cc1-1c77-4e54-b59a-aa651398d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b894f1-7aec-4f05-851a-96b58cdaff16', 'volume_name': 'volume-e8b894f1-7aec-4f05-851a-96b58cdaff16', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cef7a3-6f12-4d4b-bf8b-62cef710b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cef7a3-6f12-4d4b-bf8b-62cef710b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cc8fc7-fb45-47b0-be08-faa4122f69de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Volume e8b894f1-7aec-4f05-851a-96b58cdaff16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b894f1-7aec-4f05-851a-96b58cdaff16', 'volume_size': 1}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1673988693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b894f1-7aec-4f05-851a-96b58cdaff16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:39Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Creating volume e8b894f1-7aec-4f05-851a-96b58cdaff16 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:39 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 1073741824
Jul 07 03:40:39 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:39 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:39 devstack sudo[95402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413
Jul 07 03:40:39 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (d8eb0204-ec40-42f1-9ab3-9534fcac15c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd88a429-f28a-4a08-9e21-6ecf9c6b64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd88a429-f28a-4a08-9e21-6ecf9c6b64d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-326389461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf38ac-e106-44be-9ae0-dca6080014c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:40Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910e425b-890a-41ae-952a-fef4a1a57847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910e425b-890a-41ae-952a-fef4a1a57847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cd080f-4f43-49cd-9b90-37ac768207f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8cd080f-4f43-49cd-9b90-37ac768207f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bf38ac-e106-44be-9ae0-dca6080014c2', 'volume_name': 'volume-e7bf38ac-e106-44be-9ae0-dca6080014c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0327f3fd-b32f-4ccd-8fe7-8a612ff0f7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0327f3fd-b32f-4ccd-8fe7-8a612ff0f7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0f3522-8c32-42d0-a7a6-cf6138098e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Volume e7bf38ac-e106-44be-9ae0-dca6080014c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bf38ac-e106-44be-9ae0-dca6080014c2', 'volume_size': 1}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:40 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 1073741824" returned: 0 in 1.114s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:40 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16
Jul 07 03:40:40 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:40 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413" returned: 0 in 0.943s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:40 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413
Jul 07 03:40:40 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:41 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-326389461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf38ac-e106-44be-9ae0-dca6080014c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:40Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Creating volume e7bf38ac-e106-44be-9ae0-dca6080014c2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:41 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cc8fc7-fb45-47b0-be08-faa4122f69de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b894f1-7aec-4f05-851a-96b58cdaff16', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:41 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 1073741824
Jul 07 03:40:41 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b581e82a-142b-4613-80d8-950cc92cbf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Volume volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 (e8b894f1-7aec-4f05-851a-96b58cdaff16): created successfully
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b581e82a-142b-4613-80d8-950cc92cbf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (538623cc-61ae-4ffc-8296-739c1a2ded5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-443700b8-ca9c-43d5-9411-84cc3b5399b0 tempest-AttachVolumeNegativeTest-1233159795 None] Created volume successfully.
Jul 07 03:40:41 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.72dfa02f-bb5d-46dc-b40e-f269c8642413" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-72dfa02f-bb5d-46dc-b40e-f269c8642413" released by "_delete_snapshot" :: held 3.690s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_snapshot" :: held 3.721s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Created reservations ['ab7444b8-74b0-479b-aa15-6698ed576263', '94ef6d9c-c196-4a76-b42b-7aa710e8d0b6', 'e6b824da-8785-4621-98f4-2af83a7bc209', '3c715790-003a-46d1-8eaa-fe64b7272add'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Delete snapshot completed successfully.
Jul 07 03:40:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-65e01e2b-24fb-4f45-9fc0-a3d5f70f9e91 tempest-SnapshotsActionsTest-418062223 None] Lock "cinder-72dfa02f-bb5d-46dc-b40e-f269c8642413-delete_snapshot" released by "delete_snapshot" :: held 3.881s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:42 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 1073741824" returned: 0 in 1.034s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:42 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2
Jul 07 03:40:42 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "cinder-ac953671-25c8-4f7f-b94c-aa1680e44474-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-ac953671-25c8-4f7f-b94c-aa1680e44474-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "cinder-quobyte-ac953671-25c8-4f7f-b94c-aa1680e44474" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-ac953671-25c8-4f7f-b94c-aa1680e44474" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Deleting offline snapshot ac953671-25c8-4f7f-b94c-aa1680e44474 of volume b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] snapshot_file for this snap is: volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[851fad1f-b72b-466f-82ea-3cedc4d612c1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:42 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:42 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:43 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0f3522-8c32-42d0-a7a6-cf6138098e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bf38ac-e106-44be-9ae0-dca6080014c2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f475e8-057b-49ba-827c-442d7d09e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Volume volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 (e7bf38ac-e106-44be-9ae0-dca6080014c2): created successfully
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f475e8-057b-49ba-827c-442d7d09e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (d8eb0204-ec40-42f1-9ab3-9534fcac15c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6bf257af-afa1-49d7-843d-68161a4d62b0 tempest-VolumesListAdminTestJSON-1443599385 None] Created volume successfully.
Jul 07 03:40:43 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.832s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78464fd-3840-4de6-8621-f463530a4223(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe5448-036f-4653-bcba-f978186bffad]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:43 devstack sudo[95436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223
Jul 07 03:40:43 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:44 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223" returned: 0 in 0.949s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:44 devstack sudo[95441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:44 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (c72ec6eb-8d9d-4915-9670-ccd9859c9aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef5db51-e10f-46a0-84df-6750769cf429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef5db51-e10f-46a0-84df-6750769cf429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1081652865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9aaccf4-e91f-4494-8bed-ce8fa71870d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:45Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99b03b7-0913-4d20-8311-db06382f0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99b03b7-0913-4d20-8311-db06382f0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec730434-3596-405e-b2bc-9e1802304760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec730434-3596-405e-b2bc-9e1802304760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9aaccf4-e91f-4494-8bed-ce8fa71870d0', 'volume_name': 'volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a071a82-0c2d-4b7a-96bb-c3aa1101df7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a071a82-0c2d-4b7a-96bb-c3aa1101df7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52d2c9-ed98-48b7-bb84-129941b07233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Volume d9aaccf4-e91f-4494-8bed-ce8fa71870d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0', 'volume_size': 1}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1081652865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9aaccf4-e91f-4494-8bed-ce8fa71870d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a04de024434024b6a6fb5e03b6db82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:45Z,use_quota=True,user_id='26693bd93f4c4612ab00c99ca51c17f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Creating volume d9aaccf4-e91f-4494-8bed-ce8fa71870d0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:45 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 1073741824
Jul 07 03:40:45 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:45 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 1.194s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:45 devstack sudo[95450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474
Jul 07 03:40:45 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:46 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 1073741824" returned: 0 in 1.031s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:46 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223.ac953671-25c8-4f7f-b94c-aa1680e44474" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:46 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0
Jul 07 03:40:46 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-ac953671-25c8-4f7f-b94c-aa1680e44474" released by "_delete_snapshot" :: held 3.881s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_snapshot" :: held 3.928s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Created reservations ['fb5b7d5e-62d1-4b6e-8806-ab2013e9257b', '3d11a7a5-214b-4fe4-a278-23984684e6e9', '1531401b-4e4b-41c2-8bfe-9ddab1cf228a', '5ad53d7f-528a-4814-8730-65c929bca472'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Delete snapshot completed successfully.
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f706d112-a4d4-474c-9438-9dc4c3373ff9 tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-ac953671-25c8-4f7f-b94c-aa1680e44474-delete_snapshot" released by "delete_snapshot" :: held 4.142s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "cinder-b78464fd-3840-4de6-8621-f463530a4223-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-b78464fd-3840-4de6-8621-f463530a4223-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cfa4aa-835d-4e86-acf1-b7fa3a7f2141]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:47 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" returned: 0 in 0.756s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.931s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:47 devstack sudo[95468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52d2c9-ed98-48b7-bb84-129941b07233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:47 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdb8833-42f9-4df8-b0b2-52c385634b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b1e2fc-1536-4d8d-8eb1-e52bcb50afc7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Volume volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 (d9aaccf4-e91f-4494-8bed-ce8fa71870d0): created successfully
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fdb8833-42f9-4df8-b0b2-52c385634b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Flow 'volume_create_manager' (c72ec6eb-8d9d-4915-9670-ccd9859c9aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f4b21201-462f-4101-bf49-d419a20425af tempest-VolumesListAdminTestJSON-1443599385 None] Created volume successfully.
Jul 07 03:40:47 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16
Jul 07 03:40:47 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:47 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223" returned: 0 in 0.915s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:47 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223
Jul 07 03:40:47 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:48 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16" returned: 0 in 1.004s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.047s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-e8b894f1-7aec-4f05-851a-96b58cdaff16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9c208a3-7c36-49ea-a30f-babd26538303', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:40:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-1675bfe2-81ca-4ee2-8f87-07e0cad5a6e1 req-01ab988d-6067-4c14-8a92-aedab0ba7804 tempest-AttachVolumeNegativeTest-1233159795 None] attachment_update completed successfully.
Jul 07 03:40:48 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b78464fd-3840-4de6-8621-f463530a4223" returned: 0 in 0.777s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-quobyte-b78464fd-3840-4de6-8621-f463530a4223" released by "delete_volume" :: held 1.766s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Created reservations ['0435264f-219b-45a6-a0ee-c4faed26044a', '3abb267e-a2c7-4b95-a027-f2478eae08ed', 'a2bcc253-0af4-4650-9f31-3cebb6b79d71', 'd3a9dd63-8dff-4a4d-9e13-e9cc481ad91f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:48 devstack sudo[95548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:48 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Flow 'volume_create_manager' (de0446dc-36a2-4e91-8386-4d1ff91c38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdb958e-2ec1-47ac-9562-0964285a5c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdb958e-2ec1-47ac-9562-0964285a5c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6409d0-2fad-402a-8fd1-b7cc3b2409af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6378f8b24304abd993131c4f748ed48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:49Z,use_quota=True,user_id='fd9f3c430cbd41b8bd32ab0e12a763cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7aa813-4fb8-4d5b-afcb-5c3d93616c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7aa813-4fb8-4d5b-afcb-5c3d93616c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7ccda4-86c3-4954-acf3-23aa58acc567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab7ccda4-86c3-4954-acf3-23aa58acc567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6409d0-2fad-402a-8fd1-b7cc3b2409af', 'volume_name': 'volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c64e434-d9a6-48d4-b28c-7d04c48f0397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c64e434-d9a6-48d4-b28c-7d04c48f0397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21ea7ef-17af-4a13-8599-e2684ed2cb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Volume 8d6409d0-2fad-402a-8fd1-b7cc3b2409af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af', 'volume_size': 1}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6409d0-2fad-402a-8fd1-b7cc3b2409af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6378f8b24304abd993131c4f748ed48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:40:49Z,use_quota=True,user_id='fd9f3c430cbd41b8bd32ab0e12a763cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Creating volume 8d6409d0-2fad-402a-8fd1-b7cc3b2409af {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:40:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:40:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:49 devstack sudo[95556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af 1073741824
Jul 07 03:40:49 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:50 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.091s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:50 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Deleted volume successfully.
Jul 07 03:40:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-59ea8c94-19bb-4ef6-9ecd-42c55532410a tempest-SnapshotsActionsTest-1765067522 None] Lock "cinder-b78464fd-3840-4de6-8621-f463530a4223-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:50 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af 1073741824" returned: 0 in 1.437s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:50 devstack sudo[95882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af
Jul 07 03:40:50 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:51 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21ea7ef-17af-4a13-8599-e2684ed2cb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fac6965-142c-4829-9b47-7c78ac45f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:40:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Volume volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af (8d6409d0-2fad-402a-8fd1-b7cc3b2409af): created successfully
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fac6965-142c-4829-9b47-7c78ac45f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:40:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Flow 'volume_create_manager' (de0446dc-36a2-4e91-8386-4d1ff91c38db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:40:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6d0fa6b3-0279-464a-acdb-aed04d8ec161 tempest-VolumesListAdminTestJSON-140548342 None] Created volume successfully.
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Acquiring lock "cinder-8d6409d0-2fad-402a-8fd1-b7cc3b2409af-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "cinder-8d6409d0-2fad-402a-8fd1-b7cc3b2409af-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Acquiring lock "cinder-quobyte-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "cinder-quobyte-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e2cec-21bc-4496-bc8e-83bbc2827a57]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-d9aaccf4-e91f-4494-8bed-ce8fa71870d0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-d9aaccf4-e91f-4494-8bed-ce8fa71870d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:52 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af
Jul 07 03:40:52 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-quobyte-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c275b7-4a94-47ad-aae3-d4ac3c638c62]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:52 devstack sudo[95893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0
Jul 07 03:40:52 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:53 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" returned: 0 in 1.030s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:53 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af
Jul 07 03:40:53 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:53 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" returned: 0 in 1.136s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:53 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0
Jul 07 03:40:53 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:54 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" returned: 0 in 0.997s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "cinder-quobyte-8d6409d0-2fad-402a-8fd1-b7cc3b2409af" released by "delete_volume" :: held 2.108s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Created reservations ['4f5cd315-7e52-47b1-9d5f-08ec9ce5ae03', 'ff1c1824-c0b4-4d09-b724-dd0602178ce1', '8f4d17c6-e80b-408c-a541-b451a4a514fb', 'eda4c49c-2cd0-4bbe-954e-158e2288dadd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:54 devstack sudo[95908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:54 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:54 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-d9aaccf4-e91f-4494-8bed-ce8fa71870d0" released by "delete_volume" :: held 2.142s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Created reservations ['b043bf53-4814-4d5c-9a3b-3f6240502d21', 'df9cc20a-3640-4d80-bf26-428ae3472233', '5ad06254-afab-413b-977b-5b2c46904e9b', '74f26283-62b4-43fb-bf2a-461f03f7a246'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:55 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:55 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:55 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Deleted volume successfully.
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-02c952fc-a4a9-42dc-aa1d-fadc15931a4b tempest-VolumesListAdminTestJSON-140548342 None] Lock "cinder-8d6409d0-2fad-402a-8fd1-b7cc3b2409af-delete_volume" released by "delete_volume" :: held 3.330s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-391625d3-26cb-4ead-a59a-0d6b578dc444 req-f4b6a3d3-4610-43d6-aa48-76d1e73f3e7e tempest-AttachVolumeNegativeTest-1233159795 None] Terminate volume connection completed successfully.
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-391625d3-26cb-4ead-a59a-0d6b578dc444 req-f4b6a3d3-4610-43d6-aa48-76d1e73f3e7e tempest-AttachVolumeNegativeTest-1233159795 None] Deleting attachment b9c208a3-7c36-49ea-a30f-babd26538303. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:40:55 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.903s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Deleted volume successfully.
Jul 07 03:40:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5a3fc33-9522-48bc-97a4-e6fd063560e6 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-d9aaccf4-e91f-4494-8bed-ce8fa71870d0-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-e7bf38ac-e106-44be-9ae0-dca6080014c2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-e7bf38ac-e106-44be-9ae0-dca6080014c2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-quobyte-e7bf38ac-e106-44be-9ae0-dca6080014c2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-e7bf38ac-e106-44be-9ae0-dca6080014c2" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593c5d3-27fb-46f7-bf1b-7bf3da7de822]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:56 devstack sudo[95941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2
Jul 07 03:40:56 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:57 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2" returned: 0 in 0.930s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:57 devstack sudo[95946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2
Jul 07 03:40:57 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:58 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e7bf38ac-e106-44be-9ae0-dca6080014c2" returned: 0 in 0.976s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-e7bf38ac-e106-44be-9ae0-dca6080014c2" released by "delete_volume" :: held 1.979s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Created reservations ['72f5887b-282a-4653-a756-e8158aa051f2', '1c022de6-0949-4196-bca1-d1f0a50158e9', '64e13f2d-697a-41f6-a2b7-39da92cffd25', 'cb19d168-6644-4f90-a566-e83bec9ce6d6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:40:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:58 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:40:58 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-b4806b4d-bf5a-4e00-a365-6332321ba476-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-b4806b4d-bf5a-4e00-a365-6332321ba476-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "cinder-quobyte-b4806b4d-bf5a-4e00-a365-6332321ba476" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-b4806b4d-bf5a-4e00-a365-6332321ba476" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d64ba-6926-4c5a-a253-73fde54a263e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:40:59 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476
Jul 07 03:40:59 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:40:59 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.912s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:40:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Deleted volume successfully.
Jul 07 03:40:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25370093-5fd4-4e7a-9753-fe8142862234 tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-e7bf38ac-e106-44be-9ae0-dca6080014c2-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:00 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476" returned: 0 in 1.264s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:00 devstack sudo[95978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476
Jul 07 03:41:00 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:01 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b4806b4d-bf5a-4e00-a365-6332321ba476" returned: 0 in 0.950s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-quobyte-b4806b4d-bf5a-4e00-a365-6332321ba476" released by "delete_volume" :: held 2.283s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Created reservations ['2fef9eb0-68b5-44e6-bab4-5d1e0faf2c99', '8e33dcac-87b1-49a4-845d-e49c806eecb7', '08c1900b-fb1f-4220-9dd6-4a7544df13ff', '88979ef4-1bf1-4146-829d-6f230c1930e2'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:01 devstack sudo[95981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:41:01 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:02 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.919s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:02 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:41:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Deleted volume successfully.
Jul 07 03:41:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a4180baf-452e-4a7d-bb13-28ab5859adce tempest-VolumesListAdminTestJSON-1443599385 None] Lock "cinder-b4806b4d-bf5a-4e00-a365-6332321ba476-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:11 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=64,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=15 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:41:11 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Flow 'volume_create_manager' (38c42617-468e-4998-88a7-a341efb0434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893c5740-132e-4221-b3e4-7200debf355f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893c5740-132e-4221-b3e4-7200debf355f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-192954298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e419912-8204-4701-88c0-f90bd47ae7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76e6b85ca624a4fb7a870d9e3dc69d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:12Z,use_quota=True,user_id='138e9aa43a094b3b82cff7b9fc476284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1620c961-f682-42d6-bb4b-fd5e534b7cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1620c961-f682-42d6-bb4b-fd5e534b7cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d268c7-bf6d-47f5-aa73-0d6ffee503e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d268c7-bf6d-47f5-aa73-0d6ffee503e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e419912-8204-4701-88c0-f90bd47ae7e5', 'volume_name': 'volume-3e419912-8204-4701-88c0-f90bd47ae7e5', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f183c80>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71da553c-7db5-4016-852a-9a8d8a488072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71da553c-7db5-4016-852a-9a8d8a488072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb1ea27-8463-422e-87f4-c11709c0b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Volume 3e419912-8204-4701-88c0-f90bd47ae7e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e419912-8204-4701-88c0-f90bd47ae7e5', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f183c80>}
Jul 07 03:41:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Trying to clone 3e419912-8204-4701-88c0-f90bd47ae7e5 from image bce35279-0f3f-4049-8975-1c6590eb177b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:41:13 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:41:13 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 03:41:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbf229-c93a-4461-a958-1245236f7012]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:13 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD
Jul 07 03:41:13 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:14 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD" returned: 0 in 1.016s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:14 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b is fetched for user 138e9aa43a094b3b82cff7b9fc476284. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:41:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd0b4a6-cfe5-4393-b962-7a40c08c52f8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:14 devstack sudo[96006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD
Jul 07 03:41:14 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (bb673f98-c021-478c-ad51-195e365ed7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f097de-61ce-416d-9909-b315805ede72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f097de-61ce-416d-9909-b315805ede72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-193376416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a591b393-5d84-4954-b99b-78432dee71ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1acef2fc724b5b9fb393dd4c38a049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:15Z,use_quota=True,user_id='52371eb3390a407ca692c62acf5f6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b51c5d1-89a5-416e-ac20-c8db70ad7187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b51c5d1-89a5-416e-ac20-c8db70ad7187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d84d91-6b35-4f74-82d7-4270c6838941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d84d91-6b35-4f74-82d7-4270c6838941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a591b393-5d84-4954-b99b-78432dee71ae', 'volume_name': 'volume-a591b393-5d84-4954-b99b-78432dee71ae', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362122fa-ce66-4ff2-a151-dabb8bd047ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362122fa-ce66-4ff2-a151-dabb8bd047ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d132fd1d-5e8a-4618-a922-78ee8650f5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Volume a591b393-5d84-4954-b99b-78432dee71ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a591b393-5d84-4954-b99b-78432dee71ae', 'volume_size': 1}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-193376416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a591b393-5d84-4954-b99b-78432dee71ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1acef2fc724b5b9fb393dd4c38a049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:15Z,use_quota=True,user_id='52371eb3390a407ca692c62acf5f6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Creating volume a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:15 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae 1073741824
Jul 07 03:41:15 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:15 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD" returned: 0 in 0.983s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:15 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:41:15 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:16 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae 1073741824" returned: 0 in 0.939s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:16 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.768s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:16 devstack sudo[96034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae
Jul 07 03:41:16 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:16 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae" returned: 0 in 0.671s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-192954298',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e419912-8204-4701-88c0-f90bd47ae7e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76e6b85ca624a4fb7a870d9e3dc69d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:12Z,use_quota=True,user_id='138e9aa43a094b3b82cff7b9fc476284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Creating volume 3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:16 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1073741824
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d132fd1d-5e8a-4618-a922-78ee8650f5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a591b393-5d84-4954-b99b-78432dee71ae', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:16 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42588e2d-4679-473f-ad16-bfc89d4da4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Volume volume-a591b393-5d84-4954-b99b-78432dee71ae (a591b393-5d84-4954-b99b-78432dee71ae): created successfully
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42588e2d-4679-473f-ad16-bfc89d4da4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (bb673f98-c021-478c-ad51-195e365ed7b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9ac6b4fd-e774-4318-b7b3-f780dd12a687 tempest-VolumesDeleteCascade-1123201027 None] Created volume successfully.
Jul 07 03:41:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:17 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1073741824" returned: 0 in 1.151s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:18 devstack sudo[96043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:18 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:19 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 0 in 0.993s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.500s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Creating offline snapshot aff86164-9ca2-4a19-b50c-9a00f01bf27e of volume a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Attempting download of bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 3e419912-8204-4701-88c0-f90bd47ae7e5. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c1e3c-68bf-4aa8-8f6b-5d6c2335c03e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efc445f-954d-431e-bbb7-6673e41001e1]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:19 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae
Jul 07 03:41:19 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:19 devstack sudo[96101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1
Jul 07 03:41:19 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:20 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae" returned: 0 in 1.165s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:20 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e 1G
Jul 07 03:41:20 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:20 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1" returned: 0 in 1.103s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:20 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1
Jul 07 03:41:20 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:21 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1" returned: 1 in 0.997s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vb8lhjo1' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2db204-4bbd-443b-a266-75b852cab44c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:21 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e 1G" returned: 0 in 1.069s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:21 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:21 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:21 devstack sudo[96154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD
Jul 07 03:41:21 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:22 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 0.877s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:22 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e is being set with open permissions: ugo+rw
Jul 07 03:41:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:22 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:22 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:22 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD" returned: 0 in 0.984s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:22 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] bce35279-0f3f-4049-8975-1c6590eb177b was qcow2, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:41:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:22 devstack sudo[96169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:22 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:23 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 1.364s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:23 devstack sudo[96216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info
Jul 07 03:41:23 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:24 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info" returned: 0 in 1.147s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:24 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info is being set with open permissions: ugo+rw
Jul 07 03:41:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:24 devstack sudo[96249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info
Jul 07 03:41:24 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:25 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 0 in 3.544s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:25 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_tey67u0tdevstack@QuobyteHD, size 112.00 MB, duration 3.55 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:41:25 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Converted 112.00 MB image at 31.59 MB/s
Jul 07 03:41:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:25 devstack sudo[96252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1G
Jul 07 03:41:25 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:26 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.info" returned: 0 in 1.356s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.234s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0f0da46f-dae8-49f3-a622-e6d2ffc238d7 tempest-VolumesDeleteCascade-1123201027 None] Create snapshot completed successfully
Jul 07 03:41:26 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 1G" returned: 0 in 1.085s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2debdd-b1a4-435b-b2b1-e72b37b8b4d5]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:27 devstack sudo[96261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:27 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Creating offline snapshot 60f990fc-7a4f-400e-a2db-bab20ae91a52 of volume a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf363147-b40a-45b4-8976-dd71feb4ad5c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:28 devstack sudo[96263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:28 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:28 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 0 in 1.228s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:28 devstack sudo[96267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:28 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:29 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 1.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a591b393-5d84-4954-b99b-78432dee71ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:29 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 1G
Jul 07 03:41:29 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:30 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 1 in 1.983s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Downloaded image bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 3e419912-8204-4701-88c0-f90bd47ae7e5 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b for user 138e9aa43a094b3b82cff7b9fc476284 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Marking volume 3e419912-8204-4701-88c0-f90bd47ae7e5 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Copying metadata from image bce35279-0f3f-4049-8975-1c6590eb177b to 3e419912-8204-4701-88c0-f90bd47ae7e5. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Creating volume glance metadata for volume 3e419912-8204-4701-88c0-f90bd47ae7e5 backed by image bce35279-0f3f-4049-8975-1c6590eb177b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:DELETE=7,cinder:UPDATE=99,cinder:SELECT=84,cinder:INSERT=26 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfb1ea27-8463-422e-87f4-c11709c0b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e419912-8204-4701-88c0-f90bd47ae7e5', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f183c80>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfaa3f2-0a0f-405f-ad83-3c2e0045675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Volume volume-3e419912-8204-4701-88c0-f90bd47ae7e5 (3e419912-8204-4701-88c0-f90bd47ae7e5): created successfully
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adfaa3f2-0a0f-405f-ad83-3c2e0045675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Flow 'volume_create_manager' (38c42617-468e-4998-88a7-a341efb0434e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ae8da0c2-4ab5-4dae-9e9d-079b21b2e215 tempest-VolumesImageMetadata-516329558 None] Created volume successfully.
Jul 07 03:41:30 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 1G" returned: 0 in 1.300s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:30 devstack sudo[96284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52
Jul 07 03:41:30 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:31 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52" returned: 0 in 0.932s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 is being set with open permissions: ugo+rw
Jul 07 03:41:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Acquiring lock "cinder-3e419912-8204-4701-88c0-f90bd47ae7e5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:31 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52
Jul 07 03:41:31 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "cinder-3e419912-8204-4701-88c0-f90bd47ae7e5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Acquiring lock "cinder-quobyte-3e419912-8204-4701-88c0-f90bd47ae7e5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "cinder-quobyte-3e419912-8204-4701-88c0-f90bd47ae7e5" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fcaf31-a636-42aa-97c3-c5c394e1cf59]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:32 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:32 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:32 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52" returned: 0 in 1.024s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.283s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b7a5ba1f-1820-426e-9880-3b9b76d9c111 tempest-VolumesDeleteCascade-1123201027 None] Create snapshot completed successfully
Jul 07 03:41:33 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 0 in 0.962s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:33 devstack sudo[96296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:33 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:33 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 1 in 0.780s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:41:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:33 devstack sudo[96301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5
Jul 07 03:41:33 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-a591b393-5d84-4954-b99b-78432dee71ae-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-a591b393-5d84-4954-b99b-78432dee71ae-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Performing cascade delete. {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-60f990fc-7a4f-400e-a2db-bab20ae91a52-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-60f990fc-7a4f-400e-a2db-bab20ae91a52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-60f990fc-7a4f-400e-a2db-bab20ae91a52" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-60f990fc-7a4f-400e-a2db-bab20ae91a52" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Deleting offline snapshot 60f990fc-7a4f-400e-a2db-bab20ae91a52 of volume a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] snapshot_file for this snap is: volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce60791b-0696-4945-8f94-e1aab3dc17a1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:34 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52
Jul 07 03:41:34 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:34 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3e419912-8204-4701-88c0-f90bd47ae7e5" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "cinder-quobyte-3e419912-8204-4701-88c0-f90bd47ae7e5" released by "delete_volume" :: held 2.734s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Created reservations ['dd4c6198-3d45-4def-ad67-473ddaa6e761', '0eed9553-c2db-462a-8976-627877e3f9f8', '613e73cd-6ca5-4ef4-b441-b006e26a7455', '15082f7b-ff18-4e9c-828b-dfb33048f32b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:34 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:41:34 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:35 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52" returned: 0 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a591b393-5d84-4954-b99b-78432dee71ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe85656-a823-4e2a-b4ba-855d2c373f20]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:35 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:35 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:35 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.837s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:41:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Deleted volume successfully.
Jul 07 03:41:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1aa8ec24-646d-4462-b88b-5bcafb6377cd tempest-VolumesImageMetadata-516329558 None] Lock "cinder-3e419912-8204-4701-88c0-f90bd47ae7e5-delete_volume" released by "delete_volume" :: held 3.916s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:36 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 0.952s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a591b393-5d84-4954-b99b-78432dee71ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:36 devstack sudo[96332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52
Jul 07 03:41:36 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:37 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52" returned: 0 in 0.845s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:37 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52
Jul 07 03:41:37 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:37 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.60f990fc-7a4f-400e-a2db-bab20ae91a52" returned: 0 in 0.697s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-60f990fc-7a4f-400e-a2db-bab20ae91a52" released by "_delete_snapshot" :: held 3.530s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" released by "delete_snapshot" :: held 3.566s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['b8509e61-6901-47fa-8afb-bf6702d6375e', '502da9fa-ff66-4b21-abc3-7b4d14c97be0', '5a7cdc49-88d8-4bb2-be92-53a3e1761a7c', '291b3adf-3e5b-4f76-a390-592373a577c1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Delete snapshot completed successfully.
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-60f990fc-7a4f-400e-a2db-bab20ae91a52-delete_snapshot" released by "delete_snapshot" :: held 3.781s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-aff86164-9ca2-4a19-b50c-9a00f01bf27e-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-aff86164-9ca2-4a19-b50c-9a00f01bf27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-aff86164-9ca2-4a19-b50c-9a00f01bf27e" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-aff86164-9ca2-4a19-b50c-9a00f01bf27e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Deleting offline snapshot aff86164-9ca2-4a19-b50c-9a00f01bf27e of volume a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] snapshot_file for this snap is: volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2f4fa6-0f18-4eca-9b8d-4f66b0226597]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:38 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:38 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Flow 'volume_create_manager' (950d6d39-5519-45ab-8df1-c1494410a656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1935e40-78c8-4c3b-9e03-8030e9a87a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1935e40-78c8-4c3b-9e03-8030e9a87a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-74249193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca35a0a-ea6d-4061-86bd-dba0a4615a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b1324e10e447d2ad6741023b6147e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:39Z,use_quota=True,user_id='9a29f39f5ac34181bf16a99b26322672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff8b20d-f6de-4409-acf3-4f4d55e30508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff8b20d-f6de-4409-acf3-4f4d55e30508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6780c1f9-95fc-41fc-9a76-2bfab76b3d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6780c1f9-95fc-41fc-9a76-2bfab76b3d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca35a0a-ea6d-4061-86bd-dba0a4615a1e', 'volume_name': 'volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e105305b-3b16-41db-b27a-fd4496697bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e105305b-3b16-41db-b27a-fd4496697bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e334ef0-f8b3-4681-82a3-bb742789d068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Volume aca35a0a-ea6d-4061-86bd-dba0a4615a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e', 'volume_size': 1}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-74249193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca35a0a-ea6d-4061-86bd-dba0a4615a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b1324e10e447d2ad6741023b6147e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:39Z,use_quota=True,user_id='9a29f39f5ac34181bf16a99b26322672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Creating volume aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:38 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:38 devstack sudo[96379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e 1073741824
Jul 07 03:41:38 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:38 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a591b393-5d84-4954-b99b-78432dee71ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[60909593-9cb9-44e7-b1eb-e9130d530ed0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:39 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae
Jul 07 03:41:39 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:39 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e 1073741824" returned: 0 in 0.914s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:39 devstack sudo[96425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e
Jul 07 03:41:39 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:39 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae" returned: 0 in 0.926s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:39 devstack sudo[96429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:39 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:40 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e334ef0-f8b3-4681-82a3-bb742789d068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a158f8da-897b-4b78-a34c-7930d4613303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Volume volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e (aca35a0a-ea6d-4061-86bd-dba0a4615a1e): created successfully
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a158f8da-897b-4b78-a34c-7930d4613303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Flow 'volume_create_manager' (950d6d39-5519-45ab-8df1-c1494410a656) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fc0f2a85-3a95-4077-926f-100748e8ca96 tempest-SnapshotMetadataTestJSON-738537436 None] Created volume successfully.
Jul 07 03:41:40 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:40 devstack sudo[96435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e
Jul 07 03:41:40 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Creating offline snapshot cbdef9fb-e7b8-47f2-9191-4e2491e490db of volume aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[33095004-1f49-4760-a698-d53835671915]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:41 devstack sudo[96437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e
Jul 07 03:41:41 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:41 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae.aff86164-9ca2-4a19-b50c-9a00f01bf27e" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-aff86164-9ca2-4a19-b50c-9a00f01bf27e" released by "_delete_snapshot" :: held 3.339s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" released by "delete_snapshot" :: held 3.372s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['3c40fa26-2482-4ae5-b470-601dfda88d2e', '6907bc6f-1d2b-4a26-b1c2-d10e965fa5fb', '4cba50d0-3ad4-4c2f-a438-f3a1c2b9f344', '39704552-25b4-486f-b407-ec753872057f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Delete snapshot completed successfully.
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-aff86164-9ca2-4a19-b50c-9a00f01bf27e-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Snapshots deleted, issuing volume delete {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a79af5-acfa-4696-8a21-338c6a69e63c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:41 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae
Jul 07 03:41:41 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:41 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" returned: 0 in 0.839s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:41 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db 1G
Jul 07 03:41:41 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:42 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae" returned: 0 in 0.842s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:42 devstack sudo[96453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae
Jul 07 03:41:42 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:42 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db 1G" returned: 0 in 0.835s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:42 devstack sudo[96455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db
Jul 07 03:41:42 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:43 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a591b393-5d84-4954-b99b-78432dee71ae" returned: 0 in 0.726s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-a591b393-5d84-4954-b99b-78432dee71ae" released by "delete_volume" :: held 1.642s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['016e4449-3072-476b-8e9d-2ab3a3c0494f', '553b8da1-3a52-481c-aec1-26fb99b7c6ba', '94794290-5758-44de-b570-60d387d23ed3', '3a171f38-48b4-4666-b719-27dd061baf2d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:43 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db" returned: 0 in 0.717s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:43 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db is being set with open permissions: ugo+rw
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:43 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db
Jul 07 03:41:43 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:43 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:41:43 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:44 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:44 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.704s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:41:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Deleted volume successfully.
Jul 07 03:41:44 devstack sudo[96470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info
Jul 07 03:41:44 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-16411390-3969-477e-8f2f-531ec942257b tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-a591b393-5d84-4954-b99b-78432dee71ae-delete_volume" released by "delete_volume" :: held 10.098s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (1677e047-940b-476a-9eaa-df067b501a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2641df-8446-45f2-b14b-6346d3e791cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2641df-8446-45f2-b14b-6346d3e791cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1104905966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a42ca8-0d1b-47e1-bd67-a359d50b2cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1acef2fc724b5b9fb393dd4c38a049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:45Z,use_quota=True,user_id='52371eb3390a407ca692c62acf5f6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2d555b-f93f-4a03-a899-77747383d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2d555b-f93f-4a03-a899-77747383d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d6af0-89da-4063-b768-dfff64bbb53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88d6af0-89da-4063-b768-dfff64bbb53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a42ca8-0d1b-47e1-bd67-a359d50b2cff', 'volume_name': 'volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fddd4b-4562-42d9-b4e5-a5b58ac341e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fddd4b-4562-42d9-b4e5-a5b58ac341e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2656101-bbc9-48d1-bf95-cd44e190adb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Volume d6a42ca8-0d1b-47e1-bd67-a359d50b2cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff', 'volume_size': 1}
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:44 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:44 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info is being set with open permissions: ugo+rw
Jul 07 03:41:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:44 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info
Jul 07 03:41:44 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:45 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.info" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.548s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1104905966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a42ca8-0d1b-47e1-bd67-a359d50b2cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1acef2fc724b5b9fb393dd4c38a049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:45Z,use_quota=True,user_id='52371eb3390a407ca692c62acf5f6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Creating volume d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:45 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff 1073741824
Jul 07 03:41:45 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f2782a92-1870-4b81-aa02-c2c8090fb1bd tempest-SnapshotMetadataTestJSON-738537436 None] Create snapshot completed successfully
Jul 07 03:41:46 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff 1073741824" returned: 0 in 1.180s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:46 devstack sudo[96484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:41:46 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "cinder-cbdef9fb-e7b8-47f2-9191-4e2491e490db-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-cbdef9fb-e7b8-47f2-9191-4e2491e490db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "cinder-quobyte-cbdef9fb-e7b8-47f2-9191-4e2491e490db" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-cbdef9fb-e7b8-47f2-9191-4e2491e490db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Deleting offline snapshot cbdef9fb-e7b8-47f2-9191-4e2491e490db of volume aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] snapshot_file for this snap is: volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0eb20a-d33a-4218-82ab-9d9f9b38ac99]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Flow 'volume_create_manager' (ce91f6ca-dbf1-4750-bfb2-03456e1e5196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f12421-4e05-4223-a621-ef710aaf7eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0f12421-4e05-4223-a621-ef710aaf7eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1617926636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bc80c7-eb8b-410e-b329-899a89f71928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12368e29c4b4d37a1cd59c6ad65c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:47Z,use_quota=True,user_id='d64b0e542bbd490ea28617955f32873a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d7b010-55ca-4f14-ba8e-44f90abc7b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db
Jul 07 03:41:47 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d7b010-55ca-4f14-ba8e-44f90abc7b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372d81be-e69a-421f-9903-ef19a613f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372d81be-e69a-421f-9903-ef19a613f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bc80c7-eb8b-410e-b329-899a89f71928', 'volume_name': 'volume-a7bc80c7-eb8b-410e-b329-899a89f71928', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8650ca18-ae3b-4cc7-bd55-be31501ee2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8650ca18-ae3b-4cc7-bd55-be31501ee2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dac9f9-4272-4091-a847-c5c521ccf1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Volume a7bc80c7-eb8b-410e-b329-899a89f71928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bc80c7-eb8b-410e-b329-899a89f71928', 'volume_size': 1}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:47 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.710s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1617926636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bc80c7-eb8b-410e-b329-899a89f71928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12368e29c4b4d37a1cd59c6ad65c9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:47Z,use_quota=True,user_id='d64b0e542bbd490ea28617955f32873a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Creating volume a7bc80c7-eb8b-410e-b329-899a89f71928 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2656101-bbc9-48d1-bf95-cd44e190adb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack sudo[96489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 1073741824
Jul 07 03:41:47 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b94d8c-da80-42db-abce-7211c4f75a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Volume volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff (d6a42ca8-0d1b-47e1-bd67-a359d50b2cff): created successfully
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b94d8c-da80-42db-abce-7211c4f75a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (1677e047-940b-476a-9eaa-df067b501a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4e6a022e-722a-4907-a125-4028c46e9de7 tempest-VolumesDeleteCascade-1123201027 None] Created volume successfully.
Jul 07 03:41:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:48 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db" returned: 0 in 0.843s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3ab3b-ec99-4836-aad2-39c7e65dd815]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:48 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e
Jul 07 03:41:48 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:48 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 1073741824" returned: 0 in 0.869s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:48 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928
Jul 07 03:41:48 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:48 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" returned: 0 in 0.780s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:48 devstack sudo[96506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db
Jul 07 03:41:48 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:49 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.113s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dac9f9-4272-4091-a847-c5c521ccf1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bc80c7-eb8b-410e-b329-899a89f71928', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009bdc26-9e03-493c-8579-8e985c3bd07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Creating offline snapshot 7e8d68ee-4911-449f-a58d-206f06e87006 of volume d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:41:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Volume volume-a7bc80c7-eb8b-410e-b329-899a89f71928 (a7bc80c7-eb8b-410e-b329-899a89f71928): created successfully
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009bdc26-9e03-493c-8579-8e985c3bd07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Flow 'volume_create_manager' (ce91f6ca-dbf1-4750-bfb2-03456e1e5196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02314c-acf6-43ce-8570-fd35bc6b677e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d46903c6-17f6-48b6-9634-e9f4b7b1770e tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Created volume successfully.
Jul 07 03:41:49 devstack sudo[96509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:41:49 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:49 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:49 devstack sudo[96517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db
Jul 07 03:41:49 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:49 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.866s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:50 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 1G
Jul 07 03:41:50 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:50 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e.cbdef9fb-e7b8-47f2-9191-4e2491e490db" returned: 0 in 0.712s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-cbdef9fb-e7b8-47f2-9191-4e2491e490db" released by "_delete_snapshot" :: held 3.252s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" released by "delete_snapshot" :: held 3.285s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Created reservations ['04c569c0-d1c1-4cc2-a089-2e3c8dfe6c8a', '02510adc-0e5c-48ba-9dda-d880cd8ec992', 'd1fa983b-1c69-4252-99c1-a015a840e74d', '28981ae1-254b-4348-ac4b-f011affa42e9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Delete snapshot completed successfully.
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c2af1298-2d5e-4244-b356-0f76422dacab tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-cbdef9fb-e7b8-47f2-9191-4e2491e490db-delete_snapshot" released by "delete_snapshot" :: held 3.453s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (648953ed-f51b-490a-8f9d-5cbdbeae81e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc12228-6cf0-44a8-9c5d-23e3efdd7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc12228-6cf0-44a8-9c5d-23e3efdd7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1910417166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5331ad-2b03-4ba1-915c-91e4dd3b37b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:51Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149bc343-f916-4bb5-a380-694a256f7669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149bc343-f916-4bb5-a380-694a256f7669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9848321-2be8-45d8-a7b1-911941a8e2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9848321-2be8-45d8-a7b1-911941a8e2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5331ad-2b03-4ba1-915c-91e4dd3b37b5', 'volume_name': 'volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3924a1-59ea-4481-92b0-2c8584871d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe3924a1-59ea-4481-92b0-2c8584871d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eafc036-54d9-4899-8bc2-926297e35175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Volume af5331ad-2b03-4ba1-915c-91e4dd3b37b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5', 'volume_size': 1}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:50 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 1G" returned: 0 in 0.915s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:50 devstack sudo[96532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:41:50 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "cinder-aca35a0a-ea6d-4061-86bd-dba0a4615a1e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-aca35a0a-ea6d-4061-86bd-dba0a4615a1e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5ed014-409c-431c-a655-c68b7c76d151]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:51 devstack sudo[96550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e
Jul 07 03:41:51 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:51 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.861s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:51 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 is being set with open permissions: ugo+rw
Jul 07 03:41:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:51 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:41:51 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:52 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" returned: 0 in 0.814s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:52 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e
Jul 07 03:41:52 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:52 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:52 devstack sudo[96568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info
Jul 07 03:41:52 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:53 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-quobyte-aca35a0a-ea6d-4061-86bd-dba0a4615a1e" released by "delete_volume" :: held 1.627s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Created reservations ['8bca32ef-e527-4b9f-96ee-6e5b9338855b', '0c5138a2-b7d3-48ae-bf2c-19ca0cefb726', '578eabb9-c458-48c9-aebe-d335ff450ed5', 'b9a50ccb-f214-4f74-9cfa-2ab47dfe2ca3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:53 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:53 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info is being set with open permissions: ugo+rw
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:53 devstack sudo[96578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:41:53 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:53 devstack sudo[96579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info
Jul 07 03:41:53 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:53 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.info" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:53 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.892s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1910417166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5331ad-2b03-4ba1-915c-91e4dd3b37b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947e473edb7748baa6aa7f377e6eca5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:51Z,use_quota=True,user_id='2f1057290d6d4c65952616df8a18aca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Creating volume af5331ad-2b03-4ba1-915c-91e4dd3b37b5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:53 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.744s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:41:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Deleted volume successfully.
Jul 07 03:41:54 devstack sudo[96584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 1073741824
Jul 07 03:41:54 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3030a82c-a996-48ca-ad35-14b13bd19a98 tempest-VolumesDeleteCascade-1123201027 None] Create snapshot completed successfully
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe721c9d-93a2-41c5-beb4-dcb836292e90 tempest-SnapshotMetadataTestJSON-738537436 None] Lock "cinder-aca35a0a-ea6d-4061-86bd-dba0a4615a1e-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:54 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 1073741824" returned: 0 in 0.926s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (621f2b3e-0c8f-4d5e-bf9a-1028e1f764af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01cbd36-5495-49db-af09-776e7d13a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a01cbd36-5495-49db-af09-776e7d13a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-203774153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1acef2fc724b5b9fb393dd4c38a049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e8d68ee-4911-449f-a58d-206f06e87006,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:55Z,use_quota=True,user_id='52371eb3390a407ca692c62acf5f6a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14909546-d459-484b-8b91-33acc130b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14909546-d459-484b-8b91-33acc130b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525ffb61-57d1-485c-9adb-cf66fa3eebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (525ffb61-57d1-485c-9adb-cf66fa3eebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8', 'volume_name': 'volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8', 'volume_size': 1, 'snapshot_id': '7e8d68ee-4911-449f-a58d-206f06e87006'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa4b263-fc32-420f-88f4-97bd7396420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa4b263-fc32-420f-88f4-97bd7396420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a887221b-12df-4ca4-adf4-ac3593a80902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Volume 8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8', 'volume_size': 1, 'snapshot_id': '7e8d68ee-4911-449f-a58d-206f06e87006'}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:55 devstack sudo[96590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5
Jul 07 03:41:55 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:55 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.141s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eafc036-54d9-4899-8bc2-926297e35175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9172e829-1aaa-4c7e-b449-8e2fc6fe4968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79b58e6-3e0b-4fb2-b37f-4acfeea74709]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Volume volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 (af5331ad-2b03-4ba1-915c-91e4dd3b37b5): created successfully
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9172e829-1aaa-4c7e-b449-8e2fc6fe4968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Flow 'volume_create_manager' (648953ed-f51b-490a-8f9d-5cbdbeae81e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-853e0fe7-42ea-4823-a3d5-442391cffd82 tempest-AttachVolumeNegativeTest-1233159795 None] Created volume successfully.
Jul 07 03:41:55 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928
Jul 07 03:41:55 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:56 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928" returned: 0 in 0.849s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.535s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Creating volume 8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 from snapshot 7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-a7bc80c7-eb8b-410e-b329-899a89f71928', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9841042-1478-401f-979e-7882af80fb37', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] snapshot: 7e8d68ee-4911-449f-a58d-206f06e87006, volume: 8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b3607-b281-4593-b78e-49b59e5bf564]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Flow 'volume_create_manager' (af1097be-27e2-4879-b14c-0de0d0af4809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce8f7c1-9471-499b-8bdb-e996c7e47e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-2993484c-9b98-48e1-9867-12efecf2f832 req-99a58611-bfc0-4545-928c-947d77436d6c tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] attachment_update completed successfully.
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce8f7c1-9471-499b-8bdb-e996c7e47e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1863090129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb9186c-a1a1-485d-8a3a-6f848de29495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba6dd586ec614ce585f729f50d2bc14c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:57Z,use_quota=True,user_id='8393fd6f01d04b839b0670590d2e30e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e69134f-f703-4dcc-a723-2f3c8ec0ebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e69134f-f703-4dcc-a723-2f3c8ec0ebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:56 devstack sudo[96601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:41:56 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cdaf8b-2239-4679-94cf-21709881ef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cdaf8b-2239-4679-94cf-21709881ef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb9186c-a1a1-485d-8a3a-6f848de29495', 'volume_name': 'volume-0cb9186c-a1a1-485d-8a3a-6f848de29495', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d042fc1d-76fb-4b52-b0be-b200863cdc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d042fc1d-76fb-4b52-b0be-b200863cdc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba307b2-c43d-4719-9274-6559d0cfac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:41:56 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Volume 0cb9186c-a1a1-485d-8a3a-6f848de29495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb9186c-a1a1-485d-8a3a-6f848de29495', 'volume_size': 1}
Jul 07 03:41:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:41:57 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b46fe5-55e2-484d-9ac6-27670ba03d4f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:41:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:57 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:41:57 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:58 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Jul 07 03:41:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.813s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:41:58 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:41:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:41:58 devstack sudo[96993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8
Jul 07 03:41:58 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:41:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:03 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" returned: 0 in 5.131s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c484a8e-ac58-431f-b0e8-f9e7cbbf6c6f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:03 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:42:03 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:04 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.900s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:04 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:42:04 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Converted 1024.00 MB image at 199.53 MB/s
Jul 07 03:42:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 is being set with open permissions: ugo+rw
Jul 07 03:42:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:04 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8
Jul 07 03:42:04 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-e0bcf264-50f5-4cc3-8e2f-58008755adad req-a288c177-071b-49d4-8f54-20ee167d06cf tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Terminate volume connection completed successfully.
Jul 07 03:42:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-e0bcf264-50f5-4cc3-8e2f-58008755adad req-a288c177-071b-49d4-8f54-20ee167d06cf tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Deleting attachment b9841042-1478-401f-979e-7882af80fb37. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:42:05 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" returned: 0 in 0.675s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" released by "_copy_volume_from_snapshot" :: held 8.416s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" released by "_create_volume_from_snapshot" :: held 8.473s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.522s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.202s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1863090129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb9186c-a1a1-485d-8a3a-6f848de29495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba6dd586ec614ce585f729f50d2bc14c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:41:57Z,use_quota=True,user_id='8393fd6f01d04b839b0670590d2e30e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Creating volume 0cb9186c-a1a1-485d-8a3a-6f848de29495 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:05 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 1073741824
Jul 07 03:42:05 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a887221b-12df-4ca4-adf4-ac3593a80902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8', 'volume_size': 1, 'snapshot_id': '7e8d68ee-4911-449f-a58d-206f06e87006'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ece81-4013-418a-b80d-f8c02191d16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Volume volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 (8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8): created successfully
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ece81-4013-418a-b80d-f8c02191d16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Flow 'volume_create_manager' (621f2b3e-0c8f-4d5e-bf9a-1028e1f764af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-48c0e3ca-8918-4b67-b938-433482890512 tempest-VolumesDeleteCascade-1123201027 None] Created volume successfully.
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Performing cascade delete. {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-7e8d68ee-4911-449f-a58d-206f06e87006-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-7e8d68ee-4911-449f-a58d-206f06e87006-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Deleting offline snapshot 7e8d68ee-4911-449f-a58d-206f06e87006 of volume d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] snapshot_file for this snap is: volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ccc52e-d0f0-484f-a0ad-9dc9bab08bb8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:05 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 1073741824" returned: 0 in 0.889s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:06 devstack sudo[97057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:42:06 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:06 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495
Jul 07 03:42:06 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:06 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:42:06 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495" returned: 0 in 0.695s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.806s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[681be49f-5af6-480a-8c5c-739b1f6b514e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398cdc0-3ee6-43be-b5db-1accbe7b4db7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba307b2-c43d-4719-9274-6559d0cfac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb9186c-a1a1-485d-8a3a-6f848de29495', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be951983-433d-40ba-836f-7176de009146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Volume volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 (0cb9186c-a1a1-485d-8a3a-6f848de29495): created successfully
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be951983-433d-40ba-836f-7176de009146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Flow 'volume_create_manager' (af1097be-27e2-4879-b14c-0de0d0af4809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-37322f6c-c33d-4d6b-80df-7bff8305654d tempest-VolumesMetadataTest-435090164 None] Created volume successfully.
Jul 07 03:42:06 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:42:06 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:06 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5
Jul 07 03:42:06 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "cinder-a7bc80c7-eb8b-410e-b329-899a89f71928-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "cinder-a7bc80c7-eb8b-410e-b329-899a89f71928-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "cinder-quobyte-a7bc80c7-eb8b-410e-b329-899a89f71928" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "cinder-quobyte-a7bc80c7-eb8b-410e-b329-899a89f71928" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a7a6cc-43a8-46cc-b3a3-fbe25a23d17b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:07 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928
Jul 07 03:42:07 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:07 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.832s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:07 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" returned: 0 in 0.831s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:07 devstack sudo[97077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:42:07 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2651701c-b192-4323-88df-aa49cf4fdb13', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:42:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-089e7c86-27bd-4fed-ba2b-bb7b99268c30 req-49a9d275-4195-40d4-823e-c324b6e33267 tempest-AttachVolumeNegativeTest-1233159795 None] attachment_update completed successfully.
Jul 07 03:42:08 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928" returned: 0 in 0.931s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:08 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928
Jul 07 03:42:08 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:08 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.886s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:08 devstack sudo[97156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006
Jul 07 03:42:08 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Acquiring lock "cinder-0cb9186c-a1a1-485d-8a3a-6f848de29495-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "cinder-0cb9186c-a1a1-485d-8a3a-6f848de29495-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Acquiring lock "cinder-quobyte-0cb9186c-a1a1-485d-8a3a-6f848de29495" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "cinder-quobyte-0cb9186c-a1a1-485d-8a3a-6f848de29495" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a6698-c4af-4f40-9c4a-347006d9735a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:08 devstack sudo[97158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495
Jul 07 03:42:08 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:08 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a7bc80c7-eb8b-410e-b329-899a89f71928" returned: 0 in 0.850s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "cinder-quobyte-a7bc80c7-eb8b-410e-b329-899a89f71928" released by "delete_volume" :: held 1.839s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Created reservations ['753cb802-dce7-4967-bf86-233ebc01ffe3', '1eed7c2b-fae8-4de2-bf1c-a5d48ac19b5a', '18d25f0b-3ba5-4b0e-b732-950a3bdcca0e', '9a2ec6f3-3286-4d83-8abc-5f2fdecda32e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:09 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:09 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:09 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff.7e8d68ee-4911-449f-a58d-206f06e87006" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-7e8d68ee-4911-449f-a58d-206f06e87006" released by "_delete_snapshot" :: held 3.415s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" released by "delete_snapshot" :: held 3.441s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['89c0ba5c-edc9-45ad-a358-f59debeb767b', '47b9d115-252e-4f5b-a4dc-3ac96455fe30', 'eede88bd-e647-4d42-96a7-ff6ac1e666c5', 'c9b1bdd4-fb34-4199-8625-078532e033d9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Delete snapshot completed successfully.
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-7e8d68ee-4911-449f-a58d-206f06e87006-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Snapshots deleted, issuing volume delete {{(pid=86955) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a678aa-ada1-4a22-a88a-a6493631f03e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:09 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495" returned: 0 in 1.021s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:09 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:42:09 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:09 devstack sudo[97485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495
Jul 07 03:42:09 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:09 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Deleted volume successfully.
Jul 07 03:42:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5251ee72-f3c5-4396-9e37-330e84263795 tempest-TestServerVolumeAttachScenarioOldVersion-464848521 None] Lock "cinder-a7bc80c7-eb8b-410e-b329-899a89f71928-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:10 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0cb9186c-a1a1-485d-8a3a-6f848de29495" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "cinder-quobyte-0cb9186c-a1a1-485d-8a3a-6f848de29495" released by "delete_volume" :: held 1.765s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:10 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.880s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:10 devstack sudo[97492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff
Jul 07 03:42:10 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Created reservations ['4162808a-0ec8-4d72-bcab-02ff17017471', '4920e411-2c3e-495f-b714-c734bbc5618e', '804eae67-7d91-428e-846a-2d30019e7865', 'b37473b6-865d-4ca3-a78f-b36a914a1bec'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:10 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:10 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:11 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff" released by "delete_volume" :: held 1.744s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['23497d8c-90ba-4192-bf70-95fe92ac332f', 'b4e4e72d-1d44-42ed-9c07-7fefdb6df9fe', 'eb80e9ac-14e8-4b49-8030-fb577bab19b3', 'd1a9801d-a120-4747-930b-f01f9fd23307'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:11 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Deleted volume successfully.
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc941e5f-8a75-4cc5-89db-6c33046c52ad tempest-VolumesMetadataTest-435090164 None] Lock "cinder-0cb9186c-a1a1-485d-8a3a-6f848de29495-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:11 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:11 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:12 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.980s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Deleted volume successfully.
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=97,cinder:INSERT=30,cinder:UPDATE=95,cinder:DELETE=11 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b98a1033-765d-4094-972b-f61c92332202 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-d6a42ca8-0d1b-47e1-bd67-a359d50b2cff-delete_volume" released by "delete_volume" :: held 6.911s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aff7b1-5243-4a04-a4cf-757d891c7363]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:12 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8
Jul 07 03:42:12 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:13 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" returned: 0 in 0.868s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:13 devstack sudo[97532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8
Jul 07 03:42:13 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-9fe27f3e-b62a-4644-becf-a97218bb8e1a req-3d2c0d19-e0d9-485b-a065-b9d1cd32562f tempest-AttachVolumeNegativeTest-1233159795 None] Terminate volume connection completed successfully.
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-9fe27f3e-b62a-4644-becf-a97218bb8e1a req-3d2c0d19-e0d9-485b-a065-b9d1cd32562f tempest-AttachVolumeNegativeTest-1233159795 None] Deleting attachment 2651701c-b192-4323-88df-aa49cf4fdb13. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:42:14 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" returned: 0 in 0.724s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-quobyte-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8" released by "delete_volume" :: held 1.663s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Created reservations ['9c9c5028-df11-4942-8ea6-9ae2aad51441', '1042299c-10d5-41ec-9647-e45065524c11', '03319d47-dade-40c5-9d26-b3d68adfed60', '76799aad-565a-41c7-bf83-3cf0685e613c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:14 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:14 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:15 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.705s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Deleted volume successfully.
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bff430a1-47c9-4c7c-bf47-80abba9c9ba8 tempest-VolumesDeleteCascade-1123201027 None] Lock "cinder-8e75eaba-b7b8-46e2-b9eb-cd89bbe51bb8-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:15 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:15 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:16 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.700s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Flow 'volume_create_manager' (6147d8bd-bae8-4502-9855-5e4e98644ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591aefb0-7b99-4bcb-a821-1a5043a3d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (591aefb0-7b99-4bcb-a821-1a5043a3d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358b088-43ff-440e-95d6-f56f3e689ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c28e9e33f24408a420a059de8d080b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:17Z,use_quota=True,user_id='1dca7c9fc1ff4ddbbeba5d02c1a57e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cc6d1d-625a-44a2-bc29-764f9329c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09cc6d1d-625a-44a2-bc29-764f9329c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376aeed2-281d-46b7-a0de-eed589db2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (376aeed2-281d-46b7-a0de-eed589db2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e358b088-43ff-440e-95d6-f56f3e689ae1', 'volume_name': 'volume-e358b088-43ff-440e-95d6-f56f3e689ae1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05e1e5-80ee-4a00-adff-eb596ff30d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c05e1e5-80ee-4a00-adff-eb596ff30d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9ce9b1-1ce5-4a90-964c-37921951e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Volume e358b088-43ff-440e-95d6-f56f3e689ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e358b088-43ff-440e-95d6-f56f3e689ae1', 'volume_size': 1}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-149189588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e358b088-43ff-440e-95d6-f56f3e689ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c28e9e33f24408a420a059de8d080b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:17Z,use_quota=True,user_id='1dca7c9fc1ff4ddbbeba5d02c1a57e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Creating volume e358b088-43ff-440e-95d6-f56f3e689ae1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:16 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 1073741824
Jul 07 03:42:16 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:17 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 1073741824" returned: 0 in 0.959s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:17 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1
Jul 07 03:42:17 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Flow 'volume_create_manager' (a0b48c12-8d0e-4100-86cb-f4f0ca5c079c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bedbd4-bcba-4421-b924-cc1638dface1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77bedbd4-bcba-4421-b924-cc1638dface1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1604355572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7559ba-b03e-4e91-a1d1-1fc42f75af20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b0e18e57bd49e7b28c1e6e4088c51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:18Z,use_quota=True,user_id='8ea69a06d2344ec795db105cf64dc565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710448eb-671e-4dcf-851a-b0b2dfd96e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710448eb-671e-4dcf-851a-b0b2dfd96e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f093ee18-abfc-490e-88b1-d4238e9c3d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f093ee18-abfc-490e-88b1-d4238e9c3d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'volume_name': 'volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac41d09-bb44-445b-adfb-05da6dbbbbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac41d09-bb44-445b-adfb-05da6dbbbbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57398ed5-35ff-47e4-ad9b-17be30b6559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Volume 6c7559ba-b03e-4e91-a1d1-1fc42f75af20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'volume_size': 1}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1" returned: 0 in 0.997s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1604355572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7559ba-b03e-4e91-a1d1-1fc42f75af20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b0e18e57bd49e7b28c1e6e4088c51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:18Z,use_quota=True,user_id='8ea69a06d2344ec795db105cf64dc565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Creating volume 6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e9ce9b1-1ce5-4a90-964c-37921951e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e358b088-43ff-440e-95d6-f56f3e689ae1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack sudo[97597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 1073741824
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6de837-a5a3-453f-be89-c0545efce3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:18 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Volume volume-e358b088-43ff-440e-95d6-f56f3e689ae1 (e358b088-43ff-440e-95d6-f56f3e689ae1): created successfully
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6de837-a5a3-453f-be89-c0545efce3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Flow 'volume_create_manager' (6147d8bd-bae8-4502-9855-5e4e98644ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cb1d7e90-cf52-42d5-af2f-932d24461398 tempest-VolumesTransfersTest-424935834 None] Created volume successfully.
Jul 07 03:42:19 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 1073741824" returned: 0 in 0.981s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:19 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:19 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:20 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f72e1e81-8197-46ea-bc18-387bff0f86ec tempest-VolumesTransfersTest-1230795000 None] Transfer volume completed successfully.
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57398ed5-35ff-47e4-ad9b-17be30b6559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48c6ff-c75c-4a1d-8b99-6b8686adc0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Volume volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 (6c7559ba-b03e-4e91-a1d1-1fc42f75af20): created successfully
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d48c6ff-c75c-4a1d-8b99-6b8686adc0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Flow 'volume_create_manager' (a0b48c12-8d0e-4100-86cb-f4f0ca5c079c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3fb76e55-46ef-41be-a104-23f32c00464f tempest-VolumesCloneTest-483963747 None] Created volume successfully.
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "cinder-e358b088-43ff-440e-95d6-f56f3e689ae1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-e358b088-43ff-440e-95d6-f56f3e689ae1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "cinder-quobyte-e358b088-43ff-440e-95d6-f56f3e689ae1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-quobyte-e358b088-43ff-440e-95d6-f56f3e689ae1" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5216e1bf-b7d3-4198-85a4-ecc92b88d5e4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:21 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1
Jul 07 03:42:21 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Flow 'volume_create_manager' (59d5b764-fd84-4952-a597-03d53f188615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8cc8f99-63a2-4b9f-aa70-abf40e5aa8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8cc8f99-63a2-4b9f-aa70-abf40e5aa8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1318626796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47eceddd-3bc1-40c4-b29b-99af4ec01e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b0e18e57bd49e7b28c1e6e4088c51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=6c7559ba-b03e-4e91-a1d1-1fc42f75af20,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:22Z,use_quota=True,user_id='8ea69a06d2344ec795db105cf64dc565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf20a0b9-965c-4038-abdd-b0996730b789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf20a0b9-965c-4038-abdd-b0996730b789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d74df2-6119-4045-937e-548e5b6b75ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d74df2-6119-4045-937e-548e5b6b75ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '47eceddd-3bc1-40c4-b29b-99af4ec01e45', 'volume_name': 'volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45', 'volume_size': 2, 'source_volid': '6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d13d7c-6b24-47c1-8d02-28814d4bbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d13d7c-6b24-47c1-8d02-28814d4bbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac29040-cd4d-4d74-8045-5c2cd69e3ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Volume 47eceddd-3bc1-40c4-b29b-99af4ec01e45: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45', 'volume_size': 2, 'source_volid': '6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'source_volstatus': 'available'}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:22 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Cloning volume 6c7559ba-b03e-4e91-a1d1-1fc42f75af20 to volume 47eceddd-3bc1-40c4-b29b-99af4ec01e45
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Creating offline snapshot 221d839e-662e-4102-8c82-344ae7bfea1f of volume 6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0777dcf2-594c-42ce-96b0-f9e5a122dbad]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:22 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1" returned: 0 in 0.959s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:22 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1
Jul 07 03:42:22 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:22 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:22 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:23 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e358b088-43ff-440e-95d6-f56f3e689ae1" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-quobyte-e358b088-43ff-440e-95d6-f56f3e689ae1" released by "delete_volume" :: held 1.843s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Created reservations ['40b45ee1-c3b2-488f-9fc4-90556b71fa90', '9537b0ba-ce48-44b4-967d-e64f8c7cb238', 'a4aa7de1-7bca-4948-9f62-73f6f1aab325', '09029bd3-e056-4277-ad33-9db9e02853c8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:23 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.974s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:23 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f 1G
Jul 07 03:42:23 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:23 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:23 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:24 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Deleted volume successfully.
Jul 07 03:42:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f3f614b-f18f-43ff-9f28-8860567de91a tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-e358b088-43ff-440e-95d6-f56f3e689ae1-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Flow 'volume_create_manager' (a88cab19-978b-496d-8ba5-ef0b529245e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543dc6-4680-4c77-b961-07b9e9452e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543dc6-4680-4c77-b961-07b9e9452e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-898329043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902a12c1-1b99-46ea-8824-1a37b4881217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c28e9e33f24408a420a059de8d080b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:25Z,use_quota=True,user_id='1dca7c9fc1ff4ddbbeba5d02c1a57e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69076a8d-3e84-4faa-93ca-64b40e392e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69076a8d-3e84-4faa-93ca-64b40e392e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771ceec8-8beb-4b79-9787-1c8f48e31152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771ceec8-8beb-4b79-9787-1c8f48e31152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '902a12c1-1b99-46ea-8824-1a37b4881217', 'volume_name': 'volume-902a12c1-1b99-46ea-8824-1a37b4881217', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48084f9-3e4a-41f7-8b6a-a89b8a7b9743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:25 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e48084f9-3e4a-41f7-8b6a-a89b8a7b9743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcd80f4-5f03-413c-802b-696050c24316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Volume 902a12c1-1b99-46ea-8824-1a37b4881217: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-902a12c1-1b99-46ea-8824-1a37b4881217', 'volume_size': 1}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f 1G" returned: 0 in 1.388s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:25 devstack sudo[97638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:25 devstack sudo[97638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-af5331ad-2b03-4ba1-915c-91e4dd3b37b5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-af5331ad-2b03-4ba1-915c-91e4dd3b37b5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-quobyte-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b16e1b8-90d8-41e5-a7fe-1da950dbaca7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:25 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5
Jul 07 03:42:25 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:25 devstack sudo[97638]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:25 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f is being set with open permissions: ugo+rw
Jul 07 03:42:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:25 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:25 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:26 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" returned: 0 in 0.841s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:26 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5
Jul 07 03:42:26 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:26 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:26 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info
Jul 07 03:42:26 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:26 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-af5331ad-2b03-4ba1-915c-91e4dd3b37b5" released by "delete_volume" :: held 1.674s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Created reservations ['e3b70f84-849f-45c6-90ea-ba25ce7608a4', '300e765b-e6aa-4eef-9b12-67b70daa044a', '2ee78d44-f45b-41df-b099-7185a2cb6798', '01175d4e-66f8-40f4-9fe1-30c087deda98'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:27 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:27 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:27 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info is being set with open permissions: ugo+rw
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:27 devstack sudo[97660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info
Jul 07 03:42:27 devstack sudo[97660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-e8b894f1-7aec-4f05-851a-96b58cdaff16-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-e8b894f1-7aec-4f05-851a-96b58cdaff16-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-quobyte-e8b894f1-7aec-4f05-851a-96b58cdaff16" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-e8b894f1-7aec-4f05-851a-96b58cdaff16" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[13875c2c-1143-4582-a37c-9ce689394639]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:27 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Deleted volume successfully.
Jul 07 03:42:27 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16
Jul 07 03:42:27 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d62041c-8784-4dcb-8dd2-cb5fc5a367d9 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-af5331ad-2b03-4ba1-915c-91e4dd3b37b5-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:28 devstack sudo[97660]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.info" returned: 0 in 0.813s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] snapshot: 221d839e-662e-4102-8c82-344ae7bfea1f, volume: 47eceddd-3bc1-40c4-b29b-99af4ec01e45,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e3f29-2880-4234-830f-e4bf81902be0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:28 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:28 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:28 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16" returned: 0 in 0.820s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:28 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16
Jul 07 03:42:28 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:29 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.917s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e673fe4-744f-4b77-9de4-8a7d78a777b4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:29 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8b894f1-7aec-4f05-851a-96b58cdaff16" returned: 0 in 0.722s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-e8b894f1-7aec-4f05-851a-96b58cdaff16" released by "delete_volume" :: held 1.606s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Created reservations ['f795a449-85e7-4357-812e-8cb19914f267', 'a7e9c1cf-0f7a-4281-96b0-eb9d19b7a82d', '26e045e4-4d9a-4cc2-9132-eff195c83b20', 'd3da93d7-9c8b-4bea-9884-038e9bb80ac0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:29 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:29 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:29 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:29 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-340163fb-c2b6-426c-bae5-a333642a7014-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-340163fb-c2b6-426c-bae5-a333642a7014-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "cinder-quobyte-340163fb-c2b6-426c-bae5-a333642a7014" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:30 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:30 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.974s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-340163fb-c2b6-426c-bae5-a333642a7014" acquired by "delete_volume" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:30 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45
Jul 07 03:42:30 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Deleted volume successfully.
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b0ab27-f88d-41fe-886c-0ff40cb4ebd0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5fffd6fa-5af2-42a9-8bbe-63cbd041e930 tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-e8b894f1-7aec-4f05-851a-96b58cdaff16-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:30 devstack sudo[97695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014
Jul 07 03:42:30 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:31 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014" returned: 0 in 1.010s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:31 devstack sudo[97710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014
Jul 07 03:42:31 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:31 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:INSERT=42,cinder:SELECT=133,cinder:UPDATE=137,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (9f2fa507-8a46-47ff-88c2-ae44a00fe488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee7aca-ad8e-4178-8b02-46876ff28c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ee7aca-ad8e-4178-8b02-46876ff28c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781770162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a201b-2d1b-4b43-a28f-f8fc064ba246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:32Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bcba7b-e1c4-4932-880a-ee78c2e7d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bcba7b-e1c4-4932-880a-ee78c2e7d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437da23f-931c-49ba-906b-2c98e157e921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437da23f-931c-49ba-906b-2c98e157e921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5a201b-2d1b-4b43-a28f-f8fc064ba246', 'volume_name': 'volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb12960-0e03-4567-a8fd-5d57b1f568ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb12960-0e03-4567-a8fd-5d57b1f568ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abe6526-410a-46c8-9e7f-0c37edbd7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 4f5a201b-2d1b-4b43-a28f-f8fc064ba246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246', 'volume_size': 1}
Jul 07 03:42:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:33 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-340163fb-c2b6-426c-bae5-a333642a7014" returned: 0 in 1.898s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-quobyte-340163fb-c2b6-426c-bae5-a333642a7014" released by "delete_volume" :: held 2.989s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Created reservations ['778478a2-0b5a-4d7c-9bce-1841ddcf761b', '92c31575-2383-4e45-96cf-31a2eea131e2', '9925589d-6e6d-4156-a515-1cf07f066777', '194c8569-7124-4db3-8b86-cd0ea2bb2326'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:33 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:33 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:35 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.870s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Deleted volume successfully.
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-03342994-d25f-436b-a4ba-51eea5399cae tempest-AttachVolumeNegativeTest-1233159795 None] Lock "cinder-340163fb-c2b6-426c-bae5-a333642a7014-delete_volume" released by "delete_volume" :: held 5.353s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:35 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45" returned: 0 in 5.556s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b8401d-fd18-455f-b9ab-33c7a0863816]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:36 devstack sudo[97717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:36 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:36 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.962s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:36 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:42:36 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Converted 1024.00 MB image at 184.29 MB/s
Jul 07 03:42:36 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 is being set with open permissions: ugo+rw
Jul 07 03:42:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:36 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45
Jul 07 03:42:36 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:37 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" released by "_copy_volume_from_snapshot" :: held 9.209s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-quobyte-221d839e-662e-4102-8c82-344ae7bfea1f" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-221d839e-662e-4102-8c82-344ae7bfea1f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Deleting offline snapshot 221d839e-662e-4102-8c82-344ae7bfea1f of volume 6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] snapshot_file for this snap is: volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb671dc-b137-4a45-859e-837631389189]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:37 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:37 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:38 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.814s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:42:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0233fd-2cf5-47c3-9317-4c2d5418ce92]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:38 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:38 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:39 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:39 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:39 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:40 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:40 devstack sudo[97779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f
Jul 07 03:42:40 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:40 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20.221d839e-662e-4102-8c82-344ae7bfea1f" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-221d839e-662e-4102-8c82-344ae7bfea1f" released by "_delete_snapshot" :: held 3.120s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.050s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.634s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-898329043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=902a12c1-1b99-46ea-8824-1a37b4881217,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74c28e9e33f24408a420a059de8d080b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:25Z,use_quota=True,user_id='1dca7c9fc1ff4ddbbeba5d02c1a57e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Creating volume 902a12c1-1b99-46ea-8824-1a37b4881217 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:40 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:40 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 1073741824
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac29040-cd4d-4d74-8045-5c2cd69e3ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45', 'volume_size': 2, 'source_volid': '6c7559ba-b03e-4e91-a1d1-1fc42f75af20', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:40 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58803d7f-d14e-482b-98ed-a7bc3dbe4764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Volume volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 (47eceddd-3bc1-40c4-b29b-99af4ec01e45): created successfully
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58803d7f-d14e-482b-98ed-a7bc3dbe4764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Flow 'volume_create_manager' (59d5b764-fd84-4952-a597-03d53f188615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-54023367-301d-4acc-b91c-7e8215c1bcfb tempest-VolumesCloneTest-483963747 None] Created volume successfully.
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-47eceddd-3bc1-40c4-b29b-99af4ec01e45-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "cinder-47eceddd-3bc1-40c4-b29b-99af4ec01e45-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db51f2c-5194-448f-99fe-9d7a5e1067ca]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:41 devstack sudo[97787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45
Jul 07 03:42:41 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Flow 'volume_create_manager' (0917cf6c-2169-4b60-a569-34dbd813af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3d8a39-39d8-4277-a7b7-d571e3d1158d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3d8a39-39d8-4277-a7b7-d571e3d1158d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-761531431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5f2a8c-74b6-46cb-b695-4af1cea57e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7c65c28f4c4757a4bc4157f60618ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:42Z,use_quota=True,user_id='86e3e6c8a9094dbfb722ee4e84fc45ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8643ff7-bf7c-4f89-b098-cf56c30d34c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8643ff7-bf7c-4f89-b098-cf56c30d34c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897bc2ef-3974-4490-8fbc-bcb522efc45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897bc2ef-3974-4490-8fbc-bcb522efc45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5f2a8c-74b6-46cb-b695-4af1cea57e10', 'volume_name': 'volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7056f5-4c6f-4e50-9d27-d4f6f2c099cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d7056f5-4c6f-4e50-9d27-d4f6f2c099cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295bace-9264-40c5-90d2-77c3fd2051e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Volume dd5f2a8c-74b6-46cb-b695-4af1cea57e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10', 'volume_size': 1}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:41 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 1073741824" returned: 0 in 0.983s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:41 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217
Jul 07 03:42:41 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:42 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:42 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45
Jul 07 03:42:42 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:42 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217" returned: 0 in 0.633s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.145s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781770162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a201b-2d1b-4b43-a28f-f8fc064ba246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:32Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 4f5a201b-2d1b-4b43-a28f-f8fc064ba246 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcd80f4-5f03-413c-802b-696050c24316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-902a12c1-1b99-46ea-8824-1a37b4881217', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:42 devstack sudo[97798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 1073741824
Jul 07 03:42:42 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4087b0-1a4a-42f9-8170-31572dc3a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Volume volume-902a12c1-1b99-46ea-8824-1a37b4881217 (902a12c1-1b99-46ea-8824-1a37b4881217): created successfully
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4087b0-1a4a-42f9-8170-31572dc3a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Flow 'volume_create_manager' (a88cab19-978b-496d-8ba5-ef0b529245e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3e11dcf5-0524-44ef-9d50-db034bc38058 tempest-VolumesTransfersTest-424935834 None] Created volume successfully.
Jul 07 03:42:42 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-47eceddd-3bc1-40c4-b29b-99af4ec01e45" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-47eceddd-3bc1-40c4-b29b-99af4ec01e45" released by "delete_volume" :: held 1.575s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Created reservations ['5223b141-9283-4caf-8a7c-1fe9a7a0bc8c', 'b9caa6c9-b578-4fa0-a73c-04111b157b29', 'aa7f48b3-d6dd-4a38-9de0-390b81ac42e7', 'c97d22af-43c5-4b98-8125-8294dd48cdd4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:43 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:43 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:43 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 1073741824" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:43 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246
Jul 07 03:42:43 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-6c7559ba-b03e-4e91-a1d1-1fc42f75af20-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "cinder-6c7559ba-b03e-4e91-a1d1-1fc42f75af20-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Acquiring lock "cinder-quobyte-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1eab5-3837-49c6-82df-4ee3cc7b9350]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:43 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.828s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Deleted volume successfully.
Jul 07 03:42:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ab5d353-af12-4a05-b2a4-e3f07653d8b7 tempest-VolumesCloneTest-483963747 None] Lock "cinder-47eceddd-3bc1-40c4-b29b-99af4ec01e45-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:43 devstack sudo[97809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:43 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "cinder-902a12c1-1b99-46ea-8824-1a37b4881217-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-902a12c1-1b99-46ea-8824-1a37b4881217-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:44 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.444s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-761531431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5f2a8c-74b6-46cb-b695-4af1cea57e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7c65c28f4c4757a4bc4157f60618ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:42Z,use_quota=True,user_id='86e3e6c8a9094dbfb722ee4e84fc45ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Creating volume dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "cinder-quobyte-902a12c1-1b99-46ea-8824-1a37b4881217" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9abe6526-410a-46c8-9e7f-0c37edbd7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:44 devstack sudo[97812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 1073741824
Jul 07 03:42:44 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ef1903-eae8-42f7-a4fe-3b7f99a544c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 (4f5a201b-2d1b-4b43-a28f-f8fc064ba246): created successfully
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2ef1903-eae8-42f7-a4fe-3b7f99a544c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (9f2fa507-8a46-47ff-88c2-ae44a00fe488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-quobyte-902a12c1-1b99-46ea-8824-1a37b4881217" acquired by "delete_volume" :: waited 0.047s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa718a0f-80f4-4820-a920-f504ef5f4c0e tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d54763-d20a-47a9-b58d-75e8fcff89b6]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:44 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217
Jul 07 03:42:44 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:44 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:44 devstack sudo[97819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20
Jul 07 03:42:44 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:45 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:45 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217
Jul 07 03:42:45 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (b1b7c4f7-2579-43e5-ad69-3d07dfe77ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f0380a-c074-4701-89df-48cb796f4ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:45 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f0380a-c074-4701-89df-48cb796f4ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465538636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436c231c-329a-4f06-8726-bdfdbb5cb625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:45Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f09ee-8517-46e6-bcd6-cfde6cc69aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0f09ee-8517-46e6-bcd6-cfde6cc69aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685c5b47-1cd6-4f64-8676-d2429ba023fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685c5b47-1cd6-4f64-8676-d2429ba023fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '436c231c-329a-4f06-8726-bdfdbb5cb625', 'volume_name': 'volume-436c231c-329a-4f06-8726-bdfdbb5cb625', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611bcd19-86fd-4566-9671-9b0d425b2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611bcd19-86fd-4566-9671-9b0d425b2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3258eded-2fcf-426d-8f6d-c879fe84c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 436c231c-329a-4f06-8726-bdfdbb5cb625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-436c231c-329a-4f06-8726-bdfdbb5cb625', 'volume_size': 1}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 1073741824" returned: 0 in 1.231s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:45 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10
Jul 07 03:42:45 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:45 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" returned: 0 in 0.871s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "cinder-quobyte-6c7559ba-b03e-4e91-a1d1-1fc42f75af20" released by "delete_volume" :: held 1.822s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Created reservations ['7a3a53e8-b6ee-41e6-9d6d-85dc5645cb43', '93a241e6-2530-48cd-aed6-ff8403498c8b', '797e8341-c511-449f-abf5-49d595c2d1da', '18c2e180-5ff6-4bd2-b97c-c65f5c27dbba'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:45 devstack sudo[97835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:45 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (312f9ce7-862a-4ae3-9f5d-c6ea5ed4cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2317f8fb-d205-4775-96a3-6c4b1f5d73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2317f8fb-d205-4775-96a3-6c4b1f5d73b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824707437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad80138-711f-48b4-ae2d-9195dc7425b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:46Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ae920a-b2aa-42b8-bc99-75d7b6a2a43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ae920a-b2aa-42b8-bc99-75d7b6a2a43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80169e60-b65c-495e-ae8d-7959ce2d0a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80169e60-b65c-495e-ae8d-7959ce2d0a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ad80138-711f-48b4-ae2d-9195dc7425b0', 'volume_name': 'volume-1ad80138-711f-48b4-ae2d-9195dc7425b0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beabd8c-b3b1-4b55-a676-80f04a494df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6beabd8c-b3b1-4b55-a676-80f04a494df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9648493-8534-4b19-9778-1d1f913a4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 1ad80138-711f-48b4-ae2d-9195dc7425b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ad80138-711f-48b4-ae2d-9195dc7425b0', 'volume_size': 1}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-902a12c1-1b99-46ea-8824-1a37b4881217" returned: 0 in 1.022s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-quobyte-902a12c1-1b99-46ea-8824-1a37b4881217" released by "delete_volume" :: held 1.961s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Created reservations ['a1e2c63b-53f4-42e9-88ec-dd09da16bcb7', '7dd1a876-4948-41e5-9b56-136d7c19cf62', '4df7641d-1ae4-4562-9f8e-8187d864e016', 'ef5f03eb-1a81-475a-8b4d-1e27b1e6e64d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:46 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:46 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:46 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:46 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (1b820a91-c413-4ec1-93fd-d16b5c91bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156e8bbf-de75-4bb7-bceb-3810995d81f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.899s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" returned: 0 in 1.179s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465538636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436c231c-329a-4f06-8726-bdfdbb5cb625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:45Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 436c231c-329a-4f06-8726-bdfdbb5cb625 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156e8bbf-de75-4bb7-bceb-3810995d81f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497012344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f40644-d233-4635-b0d5-201ba4d483df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:46Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eef430-5074-42de-9ae5-4a9615df1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack sudo[97842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 1073741824
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8eef430-5074-42de-9ae5-4a9615df1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea29e8f-8c8a-4ed2-951c-adfe4a965f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea29e8f-8c8a-4ed2-951c-adfe4a965f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f40644-d233-4635-b0d5-201ba4d483df', 'volume_name': 'volume-29f40644-d233-4635-b0d5-201ba4d483df', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bb3e37-06f0-49ae-9f6e-6fc4d8d1ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0bb3e37-06f0-49ae-9f6e-6fc4d8d1ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5764e65-0348-4a4d-9837-3756d1a478b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 29f40644-d233-4635-b0d5-201ba4d483df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f40644-d233-4635-b0d5-201ba4d483df', 'volume_size': 1}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Deleted volume successfully.
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8295bace-9264-40c5-90d2-77c3fd2051e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42131d00-17dc-4d98-9baf-ce0080bb3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Volume volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 (dd5f2a8c-74b6-46cb-b695-4af1cea57e10): created successfully
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42131d00-17dc-4d98-9baf-ce0080bb3390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Flow 'volume_create_manager' (0917cf6c-2169-4b60-a569-34dbd813af55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5d8c629a-debf-4554-a9b3-36725e67a03b tempest-VolumesCloneTest-483963747 None] Lock "cinder-6c7559ba-b03e-4e91-a1d1-1fc42f75af20-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-61fab863-34b5-4167-8678-21115a53450a req-0c52fa2d-89d7-43ef-979d-8606990335a6 tempest-VolumesSnapshotsTestJSON-1212718569 None] Created volume successfully.
Jul 07 03:42:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (2816bd2c-35d3-4d42-b5b0-33fc1b0b2fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021d3ec3-15e9-4ee2-b08f-c92eebf0d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021d3ec3-15e9-4ee2-b08f-c92eebf0d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597763027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4741c618-84ba-4403-8f6c-271d3f1f86e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:47Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364595f8-e99d-41c4-8462-717bfe1acd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364595f8-e99d-41c4-8462-717bfe1acd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b4d2f-edc6-46a3-9b3f-7f53e03a49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b4d2f-edc6-46a3-9b3f-7f53e03a49a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4741c618-84ba-4403-8f6c-271d3f1f86e5', 'volume_name': 'volume-4741c618-84ba-4403-8f6c-271d3f1f86e5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41906374-e1b2-47e2-8cbd-c77a78fa6c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41906374-e1b2-47e2-8cbd-c77a78fa6c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a016e840-fe6f-4679-a943-30e86f0883b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 4741c618-84ba-4403-8f6c-271d3f1f86e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4741c618-84ba-4403-8f6c-271d3f1f86e5', 'volume_size': 1}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:47 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (f3e69d75-4c45-4b41-aab8-7ae382b2478f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e85d06-1bed-445d-bb12-acd6af18d0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.525s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22e85d06-1bed-445d-bb12-acd6af18d0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651067311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f5e006-6626-484a-acb0-96c779780615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:48Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8febf9-830b-4c92-8cbb-60cf146823c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8febf9-830b-4c92-8cbb-60cf146823c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:48 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949009d0-ed59-4b47-9e39-b3d58c566041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949009d0-ed59-4b47-9e39-b3d58c566041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f5e006-6626-484a-acb0-96c779780615', 'volume_name': 'volume-26f5e006-6626-484a-acb0-96c779780615', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468a70af-f19e-4d66-a3cb-55f0163481c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468a70af-f19e-4d66-a3cb-55f0163481c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ece39f-5a87-4b9d-941f-a4997dc5a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume 26f5e006-6626-484a-acb0-96c779780615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f5e006-6626-484a-acb0-96c779780615', 'volume_size': 1}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Deleted volume successfully.
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 1073741824" returned: 0 in 1.524s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-490d18c7-0ee9-4119-9a44-99ced4cf0547 tempest-VolumesTransfersTest-1805165102 None] Lock "cinder-902a12c1-1b99-46ea-8824-1a37b4881217-delete_volume" released by "delete_volume" :: held 4.129s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:48 devstack sudo[97848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625
Jul 07 03:42:48 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:49 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625" returned: 0 in 0.780s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (2444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.929s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-824707437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad80138-711f-48b4-ae2d-9195dc7425b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:46Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 1ad80138-711f-48b4-ae2d-9195dc7425b0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:49 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3258eded-2fcf-426d-8f6d-c879fe84c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436c231c-329a-4f06-8726-bdfdbb5cb625', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:49 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 1073741824
Jul 07 03:42:49 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adf4c66-e7f8-42f8-bccc-f79825ea1c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-436c231c-329a-4f06-8726-bdfdbb5cb625 (436c231c-329a-4f06-8726-bdfdbb5cb625): created successfully
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7adf4c66-e7f8-42f8-bccc-f79825ea1c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (b1b7c4f7-2579-43e5-ad69-3d07dfe77ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b5aa0ff8-8fca-4caf-8bc0-b42ff08135b4 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:50 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 1073741824" returned: 0 in 0.971s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:50 devstack sudo[97858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0
Jul 07 03:42:50 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:50 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0" returned: 0 in 0.708s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.093s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497012344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f40644-d233-4635-b0d5-201ba4d483df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:46Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 29f40644-d233-4635-b0d5-201ba4d483df {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:50 devstack sudo[97861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df 1073741824
Jul 07 03:42:50 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9648493-8534-4b19-9778-1d1f913a4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad80138-711f-48b4-ae2d-9195dc7425b0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd08703-74e6-4715-b9b3-6c7723178938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 (1ad80138-711f-48b4-ae2d-9195dc7425b0): created successfully
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd08703-74e6-4715-b9b3-6c7723178938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (312f9ce7-862a-4ae3-9f5d-c6ea5ed4cb72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f6402a47-f6b6-42bd-8ed3-da9341e7c111 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:51 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df 1073741824" returned: 0 in 1.060s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:51 devstack sudo[97868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df
Jul 07 03:42:51 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:52 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.463s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-597763027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4741c618-84ba-4403-8f6c-271d3f1f86e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:47Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 4741c618-84ba-4403-8f6c-271d3f1f86e5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:52 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:52 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 1073741824
Jul 07 03:42:52 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5764e65-0348-4a4d-9837-3756d1a478b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f40644-d233-4635-b0d5-201ba4d483df', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538bcb41-188c-42ca-b68f-84fa485447d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:52 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-29f40644-d233-4635-b0d5-201ba4d483df (29f40644-d233-4635-b0d5-201ba4d483df): created successfully
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538bcb41-188c-42ca-b68f-84fa485447d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (1b820a91-c413-4ec1-93fd-d16b5c91bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dd06d489-4e6c-4cd6-9925-24a714e27a62 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (d4fa020a-74bf-4387-ac1c-a3eab8370478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a694e2-4907-419b-aa41-1470c4501814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a694e2-4907-419b-aa41-1470c4501814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1610592014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f607e65-06a4-4231-8e94-6fa35192cab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:53Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c80ed-811e-4107-984e-c1e775b8058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c80ed-811e-4107-984e-c1e775b8058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8696f3f1-31e7-4335-a8b1-3eda6c1885ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8696f3f1-31e7-4335-a8b1-3eda6c1885ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f607e65-06a4-4231-8e94-6fa35192cab9', 'volume_name': 'volume-0f607e65-06a4-4231-8e94-6fa35192cab9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d975da-aa80-422e-842e-2a6fe2fd0b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d975da-aa80-422e-842e-2a6fe2fd0b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126e550-fdbe-4b48-a7ea-0a31c4e11732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Volume 0f607e65-06a4-4231-8e94-6fa35192cab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f607e65-06a4-4231-8e94-6fa35192cab9', 'volume_size': 1}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:53 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 1073741824" returned: 0 in 0.925s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:53 devstack sudo[97884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5
Jul 07 03:42:53 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (6ce120ac-dd9c-4050-b45b-9c243a338203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af583fb-11a3-4b48-9552-ef4d7d623fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5af583fb-11a3-4b48-9552-ef4d7d623fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-275446605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a028bd-d6a6-4872-bf62-44fbc9d5fb63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:54Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f91753-dfde-4ad1-8261-fb1fa55ff2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f91753-dfde-4ad1-8261-fb1fa55ff2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d6a5d5-6951-4613-86cb-ed4d4459d135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d6a5d5-6951-4613-86cb-ed4d4459d135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a028bd-d6a6-4872-bf62-44fbc9d5fb63', 'volume_name': 'volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d263a064-f092-4881-a190-78ce41f49f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d263a064-f092-4881-a190-78ce41f49f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd6d38a-19be-46db-95b6-1710601cde98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Volume 19a028bd-d6a6-4872-bf62-44fbc9d5fb63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63', 'volume_size': 1}
Jul 07 03:42:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:54 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.167s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-651067311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f5e006-6626-484a-acb0-96c779780615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2c09cbbbf74eaf80c8ecf75cebcb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:48Z,use_quota=True,user_id='30cf5bcdc7a34477a10051c9625ca4bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Creating volume 26f5e006-6626-484a-acb0-96c779780615 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:42:54 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a016e840-fe6f-4679-a943-30e86f0883b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4741c618-84ba-4403-8f6c-271d3f1f86e5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:54 devstack sudo[97887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 1073741824
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8788db4-eb6c-4b76-85aa-239cf7821add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:54 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:54 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 (4741c618-84ba-4403-8f6c-271d3f1f86e5): created successfully
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8788db4-eb6c-4b76-85aa-239cf7821add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:54 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (2816bd2c-35d3-4d42-b5b0-33fc1b0b2fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5e29d9fa-f59b-4d3b-bbfa-9999e680fefa tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:55 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 1073741824" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:55 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615
Jul 07 03:42:55 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:55 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.563s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ece39f-5a87-4b9d-941f-a4997dc5a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f5e006-6626-484a-acb0-96c779780615', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9922506e-160c-456a-8b7c-e9ee67b94a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Creating offline snapshot 16c3e89b-978e-430c-9269-ed28541ec1e3 of volume dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:42:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Volume volume-26f5e006-6626-484a-acb0-96c779780615 (26f5e006-6626-484a-acb0-96c779780615): created successfully
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9922506e-160c-456a-8b7c-e9ee67b94a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Flow 'volume_create_manager' (f3e69d75-4c45-4b41-aab8-7ae382b2478f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef40c0d-f5f9-456a-90e3-8b98ad53e792]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ce18c712-bb4a-404b-8a8d-e51cf9d4d0ee tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created volume successfully.
Jul 07 03:42:55 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10
Jul 07 03:42:55 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-26f5e006-6626-484a-acb0-96c779780615-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-26f5e006-6626-484a-acb0-96c779780615-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:56 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" returned: 0 in 0.753s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:56 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 1G
Jul 07 03:42:56 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-26f5e006-6626-484a-acb0-96c779780615" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-26f5e006-6626-484a-acb0-96c779780615" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a9ece9-573e-4825-9f9d-99b31379edb8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:56 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615
Jul 07 03:42:56 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:57 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 1G" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:57 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:57 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3
Jul 07 03:42:57 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:57 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615
Jul 07 03:42:57 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:58 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 is being set with open permissions: ugo+rw
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:58 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-26f5e006-6626-484a-acb0-96c779780615" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:58 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3
Jul 07 03:42:58 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-26f5e006-6626-484a-acb0-96c779780615" released by "delete_volume" :: held 1.488s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['7746c0a7-addd-49c6-93a2-5fd734b1b1a0', '4d7e2ae5-9938-48d1-884f-2359f743f933', '6082115d-3a5d-4f78-9af9-d23c2bcc028d', '454f373e-3f50-4c4d-8592-ee364ae9cd1c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:58 devstack sudo[97920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:42:58 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:58 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-4741c618-84ba-4403-8f6c-271d3f1f86e5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-4741c618-84ba-4403-8f6c-271d3f1f86e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-4741c618-84ba-4403-8f6c-271d3f1f86e5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:42:58 devstack sudo[97925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info
Jul 07 03:42:58 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-4741c618-84ba-4403-8f6c-271d3f1f86e5" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4ea1e-87f0-4436-8913-d81c7c59baf8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:58 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:42:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:42:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45dd9c3d-55ab-4f57-9c50-695c08852430 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-26f5e006-6626-484a-acb0-96c779780615-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:42:59 devstack sudo[97927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5
Jul 07 03:42:59 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:59 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info" returned: 0 in 0.689s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:59 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info is being set with open permissions: ugo+rw
Jul 07 03:42:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:59 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info
Jul 07 03:42:59 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:42:59 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root
Jul 07 03:42:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5" returned: 0 in 0.782s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:42:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:42:59 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5
Jul 07 03:42:59 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:00 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.info" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.971s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1610592014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f607e65-06a4-4231-8e94-6fa35192cab9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:53Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Creating volume 0f607e65-06a4-4231-8e94-6fa35192cab9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:00 devstack sudo[97938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 1073741824
Jul 07 03:43:00 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-31fb10b8-fc73-4c04-8e91-5eb3f9f6b4b6 req-91474b20-4f12-4264-aa12-a54144803040 tempest-VolumesSnapshotsTestJSON-1212718569 None] Create snapshot completed successfully
Jul 07 03:43:00 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4741c618-84ba-4403-8f6c-271d3f1f86e5" returned: 0 in 0.661s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-4741c618-84ba-4403-8f6c-271d3f1f86e5" released by "delete_volume" :: held 1.504s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['68f34349-29a1-4861-8c30-16963820ae51', 'e28db85c-7483-400d-abeb-70f02a5ca231', '0f05fac8-1fe2-48a4-8b33-0e014e65aa31', 'cbe05142-def6-402f-bc69-49678b8c7feb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:00 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:00 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-29f40644-d233-4635-b0d5-201ba4d483df-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-29f40644-d233-4635-b0d5-201ba4d483df-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:01 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 1073741824" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-29f40644-d233-4635-b0d5-201ba4d483df" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-29f40644-d233-4635-b0d5-201ba4d483df" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:01 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9
Jul 07 03:43:01 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[be66008e-b20c-4112-8daa-17425d2b869e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:01 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4ba3e097-4d8c-4032-bbcb-d48b2829b8b9 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-4741c618-84ba-4403-8f6c-271d3f1f86e5-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "cinder-16c3e89b-978e-430c-9269-ed28541ec1e3-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-16c3e89b-978e-430c-9269-ed28541ec1e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:01 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df
Jul 07 03:43:01 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "cinder-quobyte-16c3e89b-978e-430c-9269-ed28541ec1e3" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-16c3e89b-978e-430c-9269-ed28541ec1e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Deleting offline snapshot 16c3e89b-978e-430c-9269-ed28541ec1e3 of volume dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] snapshot_file for this snap is: volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23cc4e5-6c0d-4e24-ae05-6f2ea2517c03]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:01 devstack sudo[97951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3
Jul 07 03:43:01 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:01 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.077s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-275446605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a028bd-d6a6-4872-bf62-44fbc9d5fb63,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:42:54Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Creating volume 19a028bd-d6a6-4872-bf62-44fbc9d5fb63 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b126e550-fdbe-4b48-a7ea-0a31c4e11732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f607e65-06a4-4231-8e94-6fa35192cab9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:01 devstack sudo[97957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 1073741824
Jul 07 03:43:01 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2384c55-594c-4c68-b609-b63c24826b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Volume volume-0f607e65-06a4-4231-8e94-6fa35192cab9 (0f607e65-06a4-4231-8e94-6fa35192cab9): created successfully
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2384c55-594c-4c68-b609-b63c24826b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (d4fa020a-74bf-4387-ac1c-a3eab8370478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d7338ddb-bec2-4d37-8730-4fcc324bd1f5 tempest-VolumesListTestJSON-1820694020 None] Created volume successfully.
Jul 07 03:43:02 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df" returned: 0 in 0.851s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:02 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df
Jul 07 03:43:02 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:02 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d6bc6-2696-4d59-a485-0235a8624107]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:02 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10
Jul 07 03:43:02 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:02 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-29f40644-d233-4635-b0d5-201ba4d483df" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-29f40644-d233-4635-b0d5-201ba4d483df" released by "delete_volume" :: held 1.575s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['98649179-6a1c-4eca-b569-7a6ac98c180e', '45739bfb-12c0-4e49-a270-878946b2de66', 'd904a64f-7a5e-42d1-a056-fb78a2c72df8', '29857630-9120-4cb3-a862-f72d9211140a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:02 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 1073741824" returned: 0 in 0.995s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:02 devstack sudo[97972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:02 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:03 devstack sudo[97975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63
Jul 07 03:43:03 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:03 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" returned: 0 in 1.023s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:03 devstack sudo[97979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3
Jul 07 03:43:03 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-1ad80138-711f-48b4-ae2d-9195dc7425b0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-1ad80138-711f-48b4-ae2d-9195dc7425b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (0680f5ab-f0ff-4e69-9989-bf527329e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058a862f-46ab-4bfa-b318-86963bb893ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058a862f-46ab-4bfa-b318-86963bb893ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914923587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b22a2b4-9e59-471d-a3c7-74825684b189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:03Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618c0377-56ff-4af9-8373-a99f963ee5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618c0377-56ff-4af9-8373-a99f963ee5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec60bcd-7fdb-4a7d-b59b-2ceefa7f8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec60bcd-7fdb-4a7d-b59b-2ceefa7f8c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b22a2b4-9e59-471d-a3c7-74825684b189', 'volume_name': 'volume-5b22a2b4-9e59-471d-a3c7-74825684b189', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525e9084-e7e2-416f-92f7-212d47b7ae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525e9084-e7e2-416f-92f7-212d47b7ae8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d29575f-f100-4b4b-a23f-95ea38965aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Volume 5b22a2b4-9e59-471d-a3c7-74825684b189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b22a2b4-9e59-471d-a3c7-74825684b189', 'volume_size': 1}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-1ad80138-711f-48b4-ae2d-9195dc7425b0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-1ad80138-711f-48b4-ae2d-9195dc7425b0" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1db37d8-455b-4e22-9b7d-36a47bcda07a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:03 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.849s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ab0a6d34-fe78-4a20-9dfa-19431cf78b01 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-29f40644-d233-4635-b0d5-201ba4d483df-delete_volume" released by "delete_volume" :: held 2.694s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:03 devstack sudo[97982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0
Jul 07 03:43:03 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:03 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914923587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b22a2b4-9e59-471d-a3c7-74825684b189,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:03Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Creating volume 5b22a2b4-9e59-471d-a3c7-74825684b189 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:03 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:03 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 1073741824
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd6d38a-19be-46db-95b6-1710601cde98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f738a-10df-40f2-8257-3fc0844df46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Volume volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 (19a028bd-d6a6-4872-bf62-44fbc9d5fb63): created successfully
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27f738a-10df-40f2-8257-3fc0844df46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (6ce120ac-dd9c-4050-b45b-9c243a338203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8d581ab9-b4dd-4c40-a5fd-3270337892d5 tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:43:04 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3" returned: 0 in 0.819s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:04 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3
Jul 07 03:43:04 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:04 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0" returned: 0 in 0.889s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:04 devstack sudo[97998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0
Jul 07 03:43:04 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:04 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10.16c3e89b-978e-430c-9269-ed28541ec1e3" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:04 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 1073741824" returned: 0 in 1.042s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-16c3e89b-978e-430c-9269-ed28541ec1e3" released by "_delete_snapshot" :: held 3.569s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" released by "delete_snapshot" :: held 3.606s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:05 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189
Jul 07 03:43:05 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.quota [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Created reservations ['cab6ff38-01a5-4f52-82e3-800eb21b30ec', 'c36c7eee-63f0-4193-b12b-52b7f7a262cd', 'e67b8f34-a21a-4067-83c5-61966c01ca85', '217fa1b8-5464-4de6-a21b-79cec5abefc9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Delete snapshot completed successfully.
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-be171ad9-47c9-4cba-9c76-26388cf466fa req-3bb0c851-992d-4a9f-89c1-cb21f0e3377a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-16c3e89b-978e-430c-9269-ed28541ec1e3-delete_snapshot" released by "delete_snapshot" :: held 3.813s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (65dfbd6a-5b99-4561-a03d-28e2a6a5cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320aa5cd-41b0-4cae-95f2-50b794211e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320aa5cd-41b0-4cae-95f2-50b794211e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2078626047',display_name='tempest-VolumesGetTest-Volume-613905859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6890c9-36f6-450d-aad7-51d7346c1575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:05Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7ea2e-cbce-45e0-8ae4-c1b851272835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a7ea2e-cbce-45e0-8ae4-c1b851272835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d5c4c2-24c1-47f3-83ae-0b0fff1280f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d5c4c2-24c1-47f3-83ae-0b0fff1280f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d6890c9-36f6-450d-aad7-51d7346c1575', 'volume_name': 'volume-8d6890c9-36f6-450d-aad7-51d7346c1575', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f98c90-b5db-4ca2-9eb4-beeecc0e2c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f98c90-b5db-4ca2-9eb4-beeecc0e2c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfebb81-6d51-45c5-9f46-0a14218255f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Volume 8d6890c9-36f6-450d-aad7-51d7346c1575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d6890c9-36f6-450d-aad7-51d7346c1575', 'volume_size': 1}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1ad80138-711f-48b4-ae2d-9195dc7425b0" returned: 0 in 0.845s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-1ad80138-711f-48b4-ae2d-9195dc7425b0" released by "delete_volume" :: held 1.788s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['8ed6fb17-a1c1-4d69-9d7d-ab6200a30192', 'd03de71d-9829-4e7d-8d59-27aca0187ccf', '1388701e-622a-4e8e-85d2-ac50838f406f', 'fdedb87b-1908-4833-97d0-70b5f4b2b087'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:05 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:05 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-436c231c-329a-4f06-8726-bdfdbb5cb625-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-436c231c-329a-4f06-8726-bdfdbb5cb625-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-436c231c-329a-4f06-8726-bdfdbb5cb625" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-436c231c-329a-4f06-8726-bdfdbb5cb625" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:05 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c752f0-8e6a-47ca-b34b-5797f888506c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189" returned: 0 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2078626047',display_name='tempest-VolumesGetTest-Volume-613905859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d6890c9-36f6-450d-aad7-51d7346c1575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:05Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Creating volume 8d6890c9-36f6-450d-aad7-51d7346c1575 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "cinder-dd5f2a8c-74b6-46cb-b695-4af1cea57e10-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:05 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 1073741824
Jul 07 03:43:05 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d29575f-f100-4b4b-a23f-95ea38965aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b22a2b4-9e59-471d-a3c7-74825684b189', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1038489e-f0db-434c-8e90-94af736d2c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-dd5f2a8c-74b6-46cb-b695-4af1cea57e10-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Volume volume-5b22a2b4-9e59-471d-a3c7-74825684b189 (5b22a2b4-9e59-471d-a3c7-74825684b189): created successfully
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1038489e-f0db-434c-8e90-94af736d2c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (0680f5ab-f0ff-4e69-9989-bf527329e34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:05 devstack sudo[98007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625
Jul 07 03:43:05 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4bf23a8b-c8e0-412f-b8d5-21b71b9981d2 tempest-VolumesListTestJSON-1820694020 None] Created volume successfully.
Jul 07 03:43:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae1114b-c11c-46a2-8649-7c4d5eeba26e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:06 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10
Jul 07 03:43:06 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:06 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edf42661-c75e-4d32-882a-5fe23cf543e0 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-1ad80138-711f-48b4-ae2d-9195dc7425b0-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:06 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625" returned: 0 in 0.951s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:06 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625
Jul 07 03:43:06 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:06 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 1073741824" returned: 0 in 1.101s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:06 devstack sudo[98025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575
Jul 07 03:43:06 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (ce36e763-370e-42ce-b993-387fd9fadb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a1d857-baf7-4d96-b45a-43b8bff19a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a1d857-baf7-4d96-b45a-43b8bff19a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1677929631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e84590-4faa-4ae2-8912-1d203bd115ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:07Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70d41af-65a3-4419-a170-9406b17fa475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70d41af-65a3-4419-a170-9406b17fa475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28049a38-ecdd-46a8-bb05-faa4f076f02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28049a38-ecdd-46a8-bb05-faa4f076f02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e84590-4faa-4ae2-8912-1d203bd115ab', 'volume_name': 'volume-c0e84590-4faa-4ae2-8912-1d203bd115ab', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfd1017-847e-45d2-a4de-82afb7b4ecb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfd1017-847e-45d2-a4de-82afb7b4ecb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f9006-b256-460a-abda-924835b12702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Volume c0e84590-4faa-4ae2-8912-1d203bd115ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e84590-4faa-4ae2-8912-1d203bd115ab', 'volume_size': 1}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" returned: 0 in 1.154s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:07 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10
Jul 07 03:43:07 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:07 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-436c231c-329a-4f06-8726-bdfdbb5cb625" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-436c231c-329a-4f06-8726-bdfdbb5cb625" released by "delete_volume" :: held 1.716s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['2063e477-8d43-4c03-9cfb-0da7e4c5eec8', 'ab8c8798-cf53-4f59-b7be-1d8a16d77cfe', '85a3a3e2-54f8-4390-9f42-b06df3be2b13', '7f74dabb-7228-4d44-b210-bee5faa34e0f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:07 devstack sudo[98032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:07 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:07 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1677929631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e84590-4faa-4ae2-8912-1d203bd115ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b294b3d29e4d3a8db0e9eeac468e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:07Z,use_quota=True,user_id='36b1f1a643e54f39a2295219f56f9604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Creating volume c0e84590-4faa-4ae2-8912-1d203bd115ab {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:07 devstack sudo[98034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab 1073741824
Jul 07 03:43:07 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfebb81-6d51-45c5-9f46-0a14218255f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d6890c9-36f6-450d-aad7-51d7346c1575', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b93af-91bb-4a5b-932e-a3caa74e8eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Volume volume-8d6890c9-36f6-450d-aad7-51d7346c1575 (8d6890c9-36f6-450d-aad7-51d7346c1575): created successfully
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f34b93af-91bb-4a5b-932e-a3caa74e8eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (65dfbd6a-5b99-4561-a03d-28e2a6a5cea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e8601671-8a3a-4086-b7a0-9efde188656e tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:43:07 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-4f5a201b-2d1b-4b43-a28f-f8fc064ba246-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" returned: 0 in 0.710s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-quobyte-dd5f2a8c-74b6-46cb-b695-4af1cea57e10" released by "delete_volume" :: held 1.939s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-4f5a201b-2d1b-4b43-a28f-f8fc064ba246-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "cinder-quobyte-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.quota [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Created reservations ['8d3b922a-c9e3-468b-a76a-a4d96f9ad138', 'b70a16d5-d6a6-4f2d-98d4-c3982068aff6', '2d19d19f-c172-4077-8981-920377b82f59', '5215ac42-dadf-4170-bc39-1e98a43cea6e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42a2235-1ffc-4705-9070-17f426d45df4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:08 devstack sudo[98038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:08 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:08 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246
Jul 07 03:43:08 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:08 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-21aa4d9d-0dd6-47e7-a254-bc47fb1c7a92 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-436c231c-329a-4f06-8726-bdfdbb5cb625-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-8d6890c9-36f6-450d-aad7-51d7346c1575-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "cinder-8d6890c9-36f6-450d-aad7-51d7346c1575-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-8d6890c9-36f6-450d-aad7-51d7346c1575" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-8d6890c9-36f6-450d-aad7-51d7346c1575" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f1d8a0-7dd8-4c3a-abe5-1c52c9416011]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:08 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab 1073741824" returned: 0 in 1.240s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:09 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.895s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.manager [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:09 devstack sudo[98052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab
Jul 07 03:43:09 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Deleted volume successfully.
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-e9539ddb-0ffb-4b4b-8a77-dc8c14692c02 req-9d5341ea-7d90-48d2-bb19-af29a114315a tempest-VolumesSnapshotsTestJSON-1212718569 None] Lock "cinder-dd5f2a8c-74b6-46cb-b695-4af1cea57e10-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:09 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575
Jul 07 03:43:09 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:09 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" returned: 0 in 1.140s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:09 devstack sudo[98056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246
Jul 07 03:43:09 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:09 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab" returned: 0 in 0.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:09 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575" returned: 0 in 1.004s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363f9006-b256-460a-abda-924835b12702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e84590-4faa-4ae2-8912-1d203bd115ab', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39974eba-27ec-491a-936d-d5639bdc974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:09 devstack sudo[98064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575
Jul 07 03:43:09 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Volume volume-c0e84590-4faa-4ae2-8912-1d203bd115ab (c0e84590-4faa-4ae2-8912-1d203bd115ab): created successfully
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39974eba-27ec-491a-936d-d5639bdc974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Flow 'volume_create_manager' (ce36e763-370e-42ce-b993-387fd9fadb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-357b979c-dd50-4e03-b32c-6f62115b6f81 tempest-VolumesListTestJSON-1820694020 None] Created volume successfully.
Jul 07 03:43:10 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" returned: 0 in 0.787s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-quobyte-4f5a201b-2d1b-4b43-a28f-f8fc064ba246" released by "delete_volume" :: held 1.978s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Created reservations ['a5217da5-5d58-488f-8f85-495064f5c612', 'd8b1c3a3-ef61-44ca-b538-ba53009cb885', '00bc7991-0ce8-4a35-8dd2-2679906beb32', '82e06aac-e73e-48c6-9d99-3702c6f1ca72'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:10 devstack sudo[98066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:10 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:10 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d6890c9-36f6-450d-aad7-51d7346c1575" returned: 0 in 0.942s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-8d6890c9-36f6-450d-aad7-51d7346c1575" released by "delete_volume" :: held 2.007s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Created reservations ['cff023ad-524b-4acb-b35f-308b933d9f6d', '302bec9c-fc2a-4965-a7d7-3f75e118995a', '47698752-afd2-4bb5-9790-0c9d38beccf7', 'bc9e9d2a-5d27-4eca-8122-2933d49c18ee'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:11 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:11 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:11 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.995s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Deleted volume successfully.
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c992fcb1-e176-487f-be5e-56d560a21503 tempest-CreateVolumesFromSourceVolumeTest-214941805 None] Lock "cinder-4f5a201b-2d1b-4b43-a28f-f8fc064ba246-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:11 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:43:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4dcc8c64-4fa4-4f82-9508-3a5f6fa1c016 tempest-VolumesGetTest-1634979250 None] Lock "cinder-8d6890c9-36f6-450d-aad7-51d7346c1575-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-19a028bd-d6a6-4872-bf62-44fbc9d5fb63-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "cinder-19a028bd-d6a6-4872-bf62-44fbc9d5fb63-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[66306e54-7dd0-4613-a3aa-0a799acdc903]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:12 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63
Jul 07 03:43:12 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:13 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" returned: 0 in 0.962s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:13 devstack sudo[98078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63
Jul 07 03:43:13 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-c0e84590-4faa-4ae2-8912-1d203bd115ab-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-c0e84590-4faa-4ae2-8912-1d203bd115ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=193,cinder:SELECT=127,cinder:INSERT=39,cinder:DELETE=16 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-quobyte-c0e84590-4faa-4ae2-8912-1d203bd115ab" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-c0e84590-4faa-4ae2-8912-1d203bd115ab" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3e368-9199-4690-bed0-757ac98518b7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:13 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab
Jul 07 03:43:13 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:14 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" returned: 0 in 0.892s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-19a028bd-d6a6-4872-bf62-44fbc9d5fb63" released by "delete_volume" :: held 1.923s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Created reservations ['d7331a97-c4ee-4384-b6b5-a9dcd5f95725', 'b1c4d7a9-0ef2-45e6-bf14-05116caff36c', '94089004-d081-4c92-83fc-1aafae36b850', '7f814ca7-b2c7-42b7-b82c-a85b9c27095e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:14 devstack sudo[98086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:14 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:14 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab" returned: 0 in 0.986s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:14 devstack sudo[98089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab
Jul 07 03:43:14 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (d2773251-7642-4079-a6ff-fe07b62974b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ef69d8-c341-4e3b-878c-0106ce8a1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ef69d8-c341-4e3b-878c-0106ce8a1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1769463709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e375785-a300-4d44-836e-3046648a4850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:15Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90066f18-0e2d-4e17-9d89-6fb51d594e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90066f18-0e2d-4e17-9d89-6fb51d594e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faced120-6e01-4776-9ef1-dcf5e402b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faced120-6e01-4776-9ef1-dcf5e402b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e375785-a300-4d44-836e-3046648a4850', 'volume_name': 'volume-6e375785-a300-4d44-836e-3046648a4850', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb19968b-0a81-4e9b-a7f6-21cbdc844f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb19968b-0a81-4e9b-a7f6-21cbdc844f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa0db58-17e2-446b-86a0-03dd5a08e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Volume 6e375785-a300-4d44-836e-3046648a4850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e375785-a300-4d44-836e-3046648a4850', 'volume_size': 1}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1769463709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e375785-a300-4d44-836e-3046648a4850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:15Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Creating volume 6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:15 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 1073741824
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:15 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:15 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:15 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:15 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.012s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:43:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a8ba1977-eaed-4d06-ad02-c82e6e5b31e2 tempest-VolumesGetTest-1634979250 None] Lock "cinder-19a028bd-d6a6-4872-bf62-44fbc9d5fb63-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:16 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0e84590-4faa-4ae2-8912-1d203bd115ab" returned: 0 in 1.384s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-c0e84590-4faa-4ae2-8912-1d203bd115ab" released by "delete_volume" :: held 2.435s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Created reservations ['bc6c05c7-2ee0-4e26-9021-9b377e6e94e0', 'ba1485df-5cad-4c3b-aa27-a40c18f76ac8', '4f3b61d0-efbd-4e62-b171-baa61a9cf4a7', 'a23e81e4-ec8f-409e-b144-a3f17b34a497'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:16 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:16 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:16 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.997s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:43:16 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 1073741824" returned: 0 in 1.256s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:16 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:16 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-5b22a2b4-9e59-471d-a3c7-74825684b189-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-5b22a2b4-9e59-471d-a3c7-74825684b189-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:17 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Deleted volume successfully.
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-079af311-b9e8-4a42-8788-9bb69fb2e9ec tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-c0e84590-4faa-4ae2-8912-1d203bd115ab-delete_volume" released by "delete_volume" :: held 3.633s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-quobyte-5b22a2b4-9e59-471d-a3c7-74825684b189" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-5b22a2b4-9e59-471d-a3c7-74825684b189" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d8cd4-626f-4560-9b91-962861cbfddc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:17 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189
Jul 07 03:43:17 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:17 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 0.956s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa0db58-17e2-446b-86a0-03dd5a08e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e375785-a300-4d44-836e-3046648a4850', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d889d8cc-497a-4933-8cc9-e036371df134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Volume volume-6e375785-a300-4d44-836e-3046648a4850 (6e375785-a300-4d44-836e-3046648a4850): created successfully
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d889d8cc-497a-4933-8cc9-e036371df134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (d2773251-7642-4079-a6ff-fe07b62974b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-626b3f74-da26-4be3-9769-e56f0f05c6b8 tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Flow 'volume_create_manager' (f69872c3-f372-45b0-bf05-6fa53be6ba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4157432c-8225-493c-9b65-b0bbc5bc0a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4157432c-8225-493c-9b65-b0bbc5bc0a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdad5011-deb4-48df-9fa8-34805e28e656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaad8f0c9c714e9c86e0165b1b423161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:18Z,use_quota=True,user_id='4016aa421c9b4ae095b3576ff009a20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58023df-d73b-4cdf-ac67-5fd470061720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58023df-d73b-4cdf-ac67-5fd470061720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bffce6-94d9-4a6e-8c73-5276621dfb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:17 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bffce6-94d9-4a6e-8c73-5276621dfb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cdad5011-deb4-48df-9fa8-34805e28e656', 'volume_name': 'volume-cdad5011-deb4-48df-9fa8-34805e28e656', 'volume_size': 1, 'image_id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7492b54ccc1648bce0aeb0cca5809ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaad8f0c9c714e9c86e0165b1b423161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae99ed7159b4814a7800fb4e64327b7a74f078376dc044031c18278d44aa0255a170fa101144eefc7d57c6c9892504340c4641488bc7160893b3c36c80d9ccaa', 'id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'created_at': datetime.datetime(2026, 7, 7, 1, 43, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 43, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4147f92-0a3a-4f90-862a-bde54d9b24af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f3b1cd0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527e638d-bdbd-48ce-9e2e-0273fb30b376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527e638d-bdbd-48ce-9e2e-0273fb30b376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a7a7a8-f3e4-43ce-965e-78a8996c8679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Volume cdad5011-deb4-48df-9fa8-34805e28e656: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cdad5011-deb4-48df-9fa8-34805e28e656', 'volume_size': 1, 'image_id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7492b54ccc1648bce0aeb0cca5809ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaad8f0c9c714e9c86e0165b1b423161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae99ed7159b4814a7800fb4e64327b7a74f078376dc044031c18278d44aa0255a170fa101144eefc7d57c6c9892504340c4641488bc7160893b3c36c80d9ccaa', 'id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'created_at': datetime.datetime(2026, 7, 7, 1, 43, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 43, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4147f92-0a3a-4f90-862a-bde54d9b24af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f3b1cd0>}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Trying to clone cdad5011-deb4-48df-9fa8-34805e28e656 from image c4147f92-0a3a-4f90-862a-bde54d9b24af at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:43:18 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189" returned: 0 in 0.911s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:43:18 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 03:43:18 devstack sudo[98116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189
Jul 07 03:43:18 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d123a571-e613-4682-b9a3-07fb9b5ef377]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:18 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:18 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (a9fbaebd-7a12-4967-8812-74dfc682e060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a06ded-5bd7-4ba6-af73-05993c191864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a06ded-5bd7-4ba6-af73-05993c191864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634169541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1104dca5-8ed5-4c35-9cf5-34931a8eaf39,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=6e375785-a300-4d44-836e-3046648a4850,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:19Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef91778d-b40b-4c9c-ae8e-64878637f179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef91778d-b40b-4c9c-ae8e-64878637f179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c60a62-8d78-4dc5-843f-295de3e70222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c60a62-8d78-4dc5-843f-295de3e70222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1104dca5-8ed5-4c35-9cf5-34931a8eaf39', 'volume_name': 'volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39', 'volume_size': 1, 'source_volid': '6e375785-a300-4d44-836e-3046648a4850', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b369867-44f1-4208-aa3a-7b9bd0e9ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b369867-44f1-4208-aa3a-7b9bd0e9ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096a2c8-5b36-4440-8ec6-ad714150675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:19 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Volume 1104dca5-8ed5-4c35-9cf5-34931a8eaf39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39', 'volume_size': 1, 'source_volid': '6e375785-a300-4d44-836e-3046648a4850', 'source_volstatus': 'available'}
Jul 07 03:43:19 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b22a2b4-9e59-471d-a3c7-74825684b189" returned: 0 in 0.866s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:19 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Cloning volume 6e375785-a300-4d44-836e-3046648a4850 to volume 1104dca5-8ed5-4c35-9cf5-34931a8eaf39
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-5b22a2b4-9e59-471d-a3c7-74825684b189" released by "delete_volume" :: held 1.860s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Creating offline snapshot 0def5d19-5b48-43ac-b74a-6e5a8b4e232b of volume 6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Created reservations ['a2a488f4-1371-4c54-9b4a-73b0a184968d', '31d7c234-297f-442a-810e-c86c1c8d4dcc', '33b305bf-a5b7-4f68-9e5e-9f233f4842c3', '7e7244cc-5fd7-450a-9bad-c0f4082a6aca'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b264c51c-0036-452e-afc0-52557e04544f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:19 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 0 in 0.941s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:19 devstack sudo[98126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:19 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:19 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:19 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:19 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:19 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-0f607e65-06a4-4231-8e94-6fa35192cab9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-0f607e65-06a4-4231-8e94-6fa35192cab9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "cinder-quobyte-0f607e65-06a4-4231-8e94-6fa35192cab9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-0f607e65-06a4-4231-8e94-6fa35192cab9" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7927c1e6-1e1b-4985-be31-a2c035c77046]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:19 devstack sudo[98130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9
Jul 07 03:43:19 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:20 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 1 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Temporary image c4147f92-0a3a-4f90-862a-bde54d9b24af is fetched for user 4016aa421c9b4ae095b3576ff009a20d. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbc9d3b-60f9-40ed-a14c-6701cdfdaba2]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:20 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.023s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Deleted volume successfully.
Jul 07 03:43:20 devstack sudo[98136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:20 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8902c487-7f79-4b1c-95d4-eed6f72727a8 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-5b22a2b4-9e59-471d-a3c7-74825684b189-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:20 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 1.266s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:20 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b 1G
Jul 07 03:43:20 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:20 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:20 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9
Jul 07 03:43:20 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:21 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 0 in 1.054s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:21 devstack sudo[98156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:21 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:21 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b 1G" returned: 0 in 0.976s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e375785-a300-4d44-836e-3046648a4850 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:21 devstack sudo[98159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e375785-a300-4d44-836e-3046648a4850 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:21 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:21 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0f607e65-06a4-4231-8e94-6fa35192cab9" returned: 0 in 0.894s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-quobyte-0f607e65-06a4-4231-8e94-6fa35192cab9" released by "delete_volume" :: held 1.827s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Created reservations ['b14e4117-47d0-4421-9b67-4296753c1523', 'a04da4f3-1f99-4758-9afb-7fba64a567b6', '0396e0c3-9387-4367-bb6c-35122ca475df', '82a6f3d8-eaf6-42f9-a0fd-a1a2fca5a92c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:21 devstack sudo[98161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:21 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:22 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 1 in 1.052s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:22 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e375785-a300-4d44-836e-3046648a4850 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.953s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:22 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b is being set with open permissions: ugo+rw
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:22 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:22 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:22 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.962s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Deleted volume successfully.
Jul 07 03:43:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-15e33973-337f-4d19-a543-156ffaa39148 tempest-VolumesListTestJSON-1820694020 None] Lock "cinder-0f607e65-06a4-4231-8e94-6fa35192cab9-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:23 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:23 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info
Jul 07 03:43:23 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:23 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info" returned: 0 in 0.697s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info is being set with open permissions: ugo+rw
Jul 07 03:43:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:23 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info
Jul 07 03:43:23 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:24 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.info" returned: 0 in 0.759s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] snapshot: 0def5d19-5b48-43ac-b74a-6e5a8b4e232b, volume: 1104dca5-8ed5-4c35-9cf5-34931a8eaf39,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0d8c2-ffff-453d-bd1f-3a03099c4d0f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:24 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:24 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:25 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e375785-a300-4d44-836e-3046648a4850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b38e8-d7e6-4f8c-9f28-bcfd86107768]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:25 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:25 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:26 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:26 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:43:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:26 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39
Jul 07 03:43:26 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:32 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" returned: 0 in 5.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4dee7-8de6-4ab4-887c-3beb8bd2c00f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:32 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:32 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:33 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=116,cinder:INSERT=46,cinder:UPDATE=179,cinder:DELETE=16 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:43:33 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:43:33 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 1.146s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:33 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:43:33 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Converted 1024.00 MB image at 177.53 MB/s
Jul 07 03:43:33 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 is being set with open permissions: ugo+rw
Jul 07 03:43:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:33 devstack sudo[98208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39
Jul 07 03:43:33 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:34 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" released by "_copy_volume_from_snapshot" :: held 9.482s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-0def5d19-5b48-43ac-b74a-6e5a8b4e232b" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-0def5d19-5b48-43ac-b74a-6e5a8b4e232b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Deleting offline snapshot 0def5d19-5b48-43ac-b74a-6e5a8b4e232b of volume 6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] snapshot_file for this snap is: volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90da95e-790d-44dc-b1d9-18d7dac53ecc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:34 devstack sudo[98211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:34 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:35 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e375785-a300-4d44-836e-3046648a4850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c11084-393a-4010-bf3e-2b5ef6a8ec21]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:35 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:35 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:35 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:36 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:36 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:36 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.835s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:36 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b
Jul 07 03:43:36 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:37 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850.0def5d19-5b48-43ac-b74a-6e5a8b4e232b" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-0def5d19-5b48-43ac-b74a-6e5a8b4e232b" released by "_delete_snapshot" :: held 3.373s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.482s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.312s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdad5011-deb4-48df-9fa8-34805e28e656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaad8f0c9c714e9c86e0165b1b423161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:18Z,use_quota=True,user_id='4016aa421c9b4ae095b3576ff009a20d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Creating volume cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:37 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e096a2c8-5b36-4440-8ec6-ad714150675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39', 'volume_size': 1, 'source_volid': '6e375785-a300-4d44-836e-3046648a4850', 'source_volstatus': 'available'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:37 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1073741824
Jul 07 03:43:37 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc292d3a-9759-4be2-9399-d8a86807c411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Volume volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 (1104dca5-8ed5-4c35-9cf5-34931a8eaf39): created successfully
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc292d3a-9759-4be2-9399-d8a86807c411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (a9fbaebd-7a12-4967-8812-74dfc682e060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc63ac3d-e386-4ed5-895a-80b4ee2b3761 tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:43:38 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1073741824" returned: 0 in 1.052s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:38 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:38 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:39 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (38db835d-fb3a-488e-9e1b-d678ca84fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd9fe13-0fd0-4d1d-9a17-0efb09f4be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 0 in 1.128s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.241s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abd9fe13-0fd0-4d1d-9a17-0efb09f4be7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558579203',display_name='tempest-VolumesGetTest-Volume-1811937903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef95051-cd51-40c7-97d8-b13e7a97fe2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:40Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a174dfc2-dd45-4b8b-917c-500326cbb253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a174dfc2-dd45-4b8b-917c-500326cbb253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78be6009-8e46-4b0f-ae34-cd54a2135419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78be6009-8e46-4b0f-ae34-cd54a2135419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef95051-cd51-40c7-97d8-b13e7a97fe2f', 'volume_name': 'volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660c7a1-745c-4cd7-ba60-9da43808ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4660c7a1-745c-4cd7-ba60-9da43808ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2dd8e-6eaa-4e38-a525-dcdaae9b7962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Volume 5ef95051-cd51-40c7-97d8-b13e7a97fe2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f', 'volume_size': 1}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1558579203',display_name='tempest-VolumesGetTest-Volume-1811937903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef95051-cd51-40c7-97d8-b13e7a97fe2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:40Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Creating volume 5ef95051-cd51-40c7-97d8-b13e7a97fe2f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:39 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Attempting download of c4147f92-0a3a-4f90-862a-bde54d9b24af ((None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}])) to volume cdad5011-deb4-48df-9fa8-34805e28e656. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:43:39 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f 1073741824
Jul 07 03:43:39 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[92158fd3-821b-4fb9-8adb-dcfd4390421b]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:40 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu
Jul 07 03:43:40 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:41 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu" returned: 0 in 0.960s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:41 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f 1073741824" returned: 0 in 1.191s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:41 devstack sudo[98285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu
Jul 07 03:43:41 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:41 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f
Jul 07 03:43:41 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:42 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:42 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (f94aa810-f811-4fa9-a20c-87607bf65724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdadae64-2481-447b-9860-2edea2264694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" returned: 0 in 0.879s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu" returned: 1 in 1.034s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4147f92-0a3a-4f90-862a-bde54d9b24af__gj8lhbu' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b2dd8e-6eaa-4e38-a525-dcdaae9b7962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df5afc2-71dc-4c36-8e31-3dcd7da9c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[68afdde9-fafa-4c87-ab67-934d28ff2c58]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdadae64-2481-447b-9860-2edea2264694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-252016202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5b05b2-938f-40a9-898a-ad8785c06c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:42Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec32bb9-7654-4efd-9a27-5f2e67ede6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec32bb9-7654-4efd-9a27-5f2e67ede6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5c4953-1916-4cc9-b4c1-f7a3ee9ffc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5c4953-1916-4cc9-b4c1-f7a3ee9ffc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5b05b2-938f-40a9-898a-ad8785c06c82', 'volume_name': 'volume-9e5b05b2-938f-40a9-898a-ad8785c06c82', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d71ad71-f9af-4f27-b7a1-bea1b100557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d71ad71-f9af-4f27-b7a1-bea1b100557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d17e38-7ec8-43ae-a90f-bf094efa945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Volume 9e5b05b2-938f-40a9-898a-ad8785c06c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5b05b2-938f-40a9-898a-ad8785c06c82', 'volume_size': 1}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-252016202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5b05b2-938f-40a9-898a-ad8785c06c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:42Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Creating volume 9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:42 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 1073741824
Jul 07 03:43:42 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Volume volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f (5ef95051-cd51-40c7-97d8-b13e7a97fe2f): created successfully
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df5afc2-71dc-4c36-8e31-3dcd7da9c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (38db835d-fb3a-488e-9e1b-d678ca84fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2787d08b-6fe5-4009-ba05-2fbf0c2729a8 tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:43:42 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:42 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:43 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-5ef95051-cd51-40c7-97d8-b13e7a97fe2f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:43 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD
Jul 07 03:43:43 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "cinder-5ef95051-cd51-40c7-97d8-b13e7a97fe2f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:43 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 1073741824" returned: 0 in 1.041s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:43 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82
Jul 07 03:43:43 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4a2fa3-5d8f-48d2-bf3f-6aa1a1e33990]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:43 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f
Jul 07 03:43:43 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:43 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD" returned: 1 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] c4147f92-0a3a-4f90-862a-bde54d9b24af was raw, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:43 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:43 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:43 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d17e38-7ec8-43ae-a90f-bf094efa945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5b05b2-938f-40a9-898a-ad8785c06c82', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4432d7b-ca2e-4211-8b69-e7c9d53edf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Volume volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 (9e5b05b2-938f-40a9-898a-ad8785c06c82): created successfully
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4432d7b-ca2e-4211-8b69-e7c9d53edf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (f94aa810-f811-4fa9-a20c-87607bf65724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9399e86b-b567-4e02-9f1b-02019ec52add tempest-VolumesSnapshotTestJSON-381061207 None] Created volume successfully.
Jul 07 03:43:44 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:44 devstack sudo[98317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f
Jul 07 03:43:44 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:44 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 0 in 0.871s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4147f92-0a3a-4f90-862a-bde54d9b24af_t2g_to49devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:43:44 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:44 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1G
Jul 07 03:43:44 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:44 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" returned: 0 in 0.689s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-5ef95051-cd51-40c7-97d8-b13e7a97fe2f" released by "delete_volume" :: held 1.663s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Created reservations ['557c4a8a-e0c8-4db9-92f6-d39cbd9db509', '5596ed4a-f343-4810-9adc-0063d106289c', 'ff43a5ed-eed9-4ef4-95c5-a31bdf3a46d2', 'c526988b-1098-473e-a4aa-ff10c3629259'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:45 devstack sudo[98325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:45 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Creating offline snapshot 22721506-392b-49ee-b03e-08127b42d2f8 of volume 9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[57060972-686d-42b3-bdc1-b7cb77ef3d93]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-1104dca5-8ed5-4c35-9cf5-34931a8eaf39-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "cinder-1104dca5-8ed5-4c35-9cf5-34931a8eaf39-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:45 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82
Jul 07 03:43:45 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:45 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 1G" returned: 0 in 1.044s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec118451-e5ce-4413-8560-fd9e92b765fc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130afda-7821-4922-a87c-5a12215b0823]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:45 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:45 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:46 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39
Jul 07 03:43:46 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:46 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.039s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0b07e3f2-79ea-4491-9953-dfdf93820efc tempest-VolumesGetTest-1634979250 None] Lock "cinder-5ef95051-cd51-40c7-97d8-b13e7a97fe2f-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:46 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82" returned: 0 in 1.113s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:46 devstack sudo[98343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 1G
Jul 07 03:43:46 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:46 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 0 in 1.127s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:47 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" returned: 0 in 1.213s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:47 devstack sudo[98349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39
Jul 07 03:43:47 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:47 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:47 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:47 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 1 in 0.866s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Downloaded image c4147f92-0a3a-4f90-862a-bde54d9b24af ((None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}])) to volume cdad5011-deb4-48df-9fa8-34805e28e656 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Temporary image c4147f92-0a3a-4f90-862a-bde54d9b24af for user 4016aa421c9b4ae095b3576ff009a20d is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Marking volume cdad5011-deb4-48df-9fa8-34805e28e656 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Copying metadata from image c4147f92-0a3a-4f90-862a-bde54d9b24af to cdad5011-deb4-48df-9fa8-34805e28e656. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Creating volume glance metadata for volume cdad5011-deb4-48df-9fa8-34805e28e656 backed by image c4147f92-0a3a-4f90-862a-bde54d9b24af with: {'image_id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e7492b54ccc1648bce0aeb0cca5809ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:43:47 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:47 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" returned: 0 in 0.832s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 1G" returned: 0 in 1.141s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-1104dca5-8ed5-4c35-9cf5-34931a8eaf39" released by "delete_volume" :: held 2.122s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:47 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8
Jul 07 03:43:47 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a7a7a8-f3e4-43ce-965e-78a8996c8679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdad5011-deb4-48df-9fa8-34805e28e656', 'volume_size': 1, 'image_id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4147f92-0a3a-4f90-862a-bde54d9b24af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7492b54ccc1648bce0aeb0cca5809ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaad8f0c9c714e9c86e0165b1b423161', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae99ed7159b4814a7800fb4e64327b7a74f078376dc044031c18278d44aa0255a170fa101144eefc7d57c6c9892504340c4641488bc7160893b3c36c80d9ccaa', 'id': 'c4147f92-0a3a-4f90-862a-bde54d9b24af', 'created_at': datetime.datetime(2026, 7, 7, 1, 43, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 43, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4147f92-0a3a-4f90-862a-bde54d9b24af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f3b1cd0>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a488ea7d-d3d4-43d8-a800-b8506f962d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Created reservations ['6bf7af54-e95f-4e45-8c4c-7637c294eb6c', 'ae8792dd-c792-471b-b1a8-0db48cf6553e', 'c1d41a15-2337-4b3e-b5da-59ba731caf8c', 'bfe59fc9-8ba3-4508-ad7a-ac7c87ab4ae6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Volume volume-cdad5011-deb4-48df-9fa8-34805e28e656 (cdad5011-deb4-48df-9fa8-34805e28e656): created successfully
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a488ea7d-d3d4-43d8-a800-b8506f962d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Flow 'volume_create_manager' (f69872c3-f372-45b0-bf05-6fa53be6ba28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a560d6e1-d707-4e1e-9a46-3e5cbfd0384f tempest-VolumeImageDependencyTests-1619139315 None] Created volume successfully.
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:48 devstack sudo[98363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:48 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:48 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Acquiring lock "cinder-cdad5011-deb4-48df-9fa8-34805e28e656-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8" returned: 0 in 0.868s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:48 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 is being set with open permissions: ugo+rw
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "cinder-cdad5011-deb4-48df-9fa8-34805e28e656-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:48 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8
Jul 07 03:43:48 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Acquiring lock "cinder-quobyte-cdad5011-deb4-48df-9fa8-34805e28e656" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "cinder-quobyte-cdad5011-deb4-48df-9fa8-34805e28e656" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:48 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b7b12-6f68-4716-9d33-3d70db7c3265]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ea48f21a-fcb6-4d18-aaef-464f1e8695bb tempest-VolumesGetTest-1634979250 None] Lock "cinder-1104dca5-8ed5-4c35-9cf5-34931a8eaf39-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:49 devstack sudo[98372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:49 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-6e375785-a300-4d44-836e-3046648a4850-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "cinder-6e375785-a300-4d44-836e-3046648a4850-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-6e375785-a300-4d44-836e-3046648a4850" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-6e375785-a300-4d44-836e-3046648a4850" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a2b51-284b-4f0d-b4ed-1b4a7b1d6d10]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:49 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:49 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:49 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8" returned: 0 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:49 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info
Jul 07 03:43:49 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:49 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:49 devstack sudo[98381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:49 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:50 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 0.935s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:50 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:50 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info is being set with open permissions: ugo+rw
Jul 07 03:43:50 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:50 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info
Jul 07 03:43:50 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:50 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 1 in 0.911s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:50 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656
Jul 07 03:43:50 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Flow 'volume_create_manager' (7bb19cee-fb5a-47e5-b828-6381df27eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da4d483-b734-48cb-90ca-34d1c63f98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da4d483-b734-48cb-90ca-34d1c63f98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-123725960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9f1045-7ee6-4842-83a8-fdfdf4c87051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a364ac5759c4aca8501634fc4786232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:51Z,use_quota=True,user_id='c0e5084f7a594427ae249c3ffebe9bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0570680-9e14-43ee-9420-11e57a88b08d),volume_type_id=a0570680-9e14-43ee-9420-11e57a88b08d)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f5487-5e89-45ff-9049-1ee14a51334c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32f5487-5e89-45ff-9049-1ee14a51334c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598bba21-859e-4587-9a26-d16df4ddcb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598bba21-859e-4587-9a26-d16df4ddcb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9f1045-7ee6-4842-83a8-fdfdf4c87051', 'volume_name': 'volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5a6912-f26b-4f7d-9a0c-f42879470533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5a6912-f26b-4f7d-9a0c-f42879470533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653216a5-f7c9-41a9-9de2-70b491b0e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Volume 7b9f1045-7ee6-4842-83a8-fdfdf4c87051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051', 'volume_size': 1}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:51 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6e375785-a300-4d44-836e-3046648a4850" returned: 0 in 0.806s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-6e375785-a300-4d44-836e-3046648a4850" released by "delete_volume" :: held 1.811s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:51 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.info" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.543s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-123725960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9f1045-7ee6-4842-83a8-fdfdf4c87051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a364ac5759c4aca8501634fc4786232',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:51Z,use_quota=True,user_id='c0e5084f7a594427ae249c3ffebe9bcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0570680-9e14-43ee-9420-11e57a88b08d),volume_type_id=a0570680-9e14-43ee-9420-11e57a88b08d)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Creating volume 7b9f1045-7ee6-4842-83a8-fdfdf4c87051 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:51 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 1073741824
Jul 07 03:43:51 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ea5a8935-4936-4e07-9bd9-4861e8d0a113 tempest-VolumesSnapshotTestJSON-381061207 None] Create snapshot completed successfully
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Created reservations ['3d8be84e-dcc0-44ca-b657-3296bc4bee5b', '8e24b515-55d1-4cc3-96dd-06cb11a80915', '2a4e40fc-3c92-493d-9b9c-52b7aa7bb8f4', '7c91198e-68e4-45f1-b1a3-a8f83ea52586'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:51 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:51 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:51 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-cdad5011-deb4-48df-9fa8-34805e28e656" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "cinder-quobyte-cdad5011-deb4-48df-9fa8-34805e28e656" released by "delete_volume" :: held 2.652s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Created reservations ['68a1d36c-856e-422b-883c-8a0e115a0fe2', 'f5cb74f4-daa2-44eb-b3c3-522d18236014', '6513ef2c-cab1-4cde-ab1e-ddccd685eb0f', '4771519b-d57e-47c5-a462-eb8b8e62ea82'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:51 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:51 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:52 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.870s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ba23696c-afc7-4bca-a657-4c9294551756 tempest-VolumesGetTest-1634979250 None] Lock "cinder-6e375785-a300-4d44-836e-3046648a4850-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-22721506-392b-49ee-b03e-08127b42d2f8-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-22721506-392b-49ee-b03e-08127b42d2f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:52 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 1073741824" returned: 0 in 1.174s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-22721506-392b-49ee-b03e-08127b42d2f8" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:52 devstack sudo[98411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051
Jul 07 03:43:52 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-22721506-392b-49ee-b03e-08127b42d2f8" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Deleting offline snapshot 22721506-392b-49ee-b03e-08127b42d2f8 of volume 9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] snapshot_file for this snap is: volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (a1e683cf-4dad-487c-865b-ac2188b09c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:52 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21ea60-0912-4c7b-95af-8701e5040f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[97166f4a-64bd-470d-a818-d2ded082d523]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.923s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Deleted volume successfully.
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c21ea60-0912-4c7b-95af-8701e5040f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1604665832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77071b3-2bbf-4f7c-b182-5658f6a115bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:52Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f724346-7523-448f-9776-db47ac98f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f724346-7523-448f-9776-db47ac98f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4098a-7a80-4d8b-8c43-0645405584a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:43:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-68a96398-a0d8-49e0-b849-7da7f76144d2 tempest-VolumeImageDependencyTests-1619139315 None] Lock "cinder-cdad5011-deb4-48df-9fa8-34805e28e656-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:52 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8
Jul 07 03:43:52 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:53 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b4098a-7a80-4d8b-8c43-0645405584a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b77071b3-2bbf-4f7c-b182-5658f6a115bf', 'volume_name': 'volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f04e900>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09145955-50a5-4987-90bb-a47c6c4b73f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09145955-50a5-4987-90bb-a47c6c4b73f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac556d5-99aa-4500-813e-b1b1f4fc1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Volume b77071b3-2bbf-4f7c-b182-5658f6a115bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f04e900>}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Trying to clone b77071b3-2bbf-4f7c-b182-5658f6a115bf from image bce35279-0f3f-4049-8975-1c6590eb177b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" returned: 0 in 0.865s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (653216a5-f7c9-41a9-9de2-70b491b0e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ec509a-4ded-4770-aede-e7b5c26c6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Volume volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 (7b9f1045-7ee6-4842-83a8-fdfdf4c87051): created successfully
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ec509a-4ded-4770-aede-e7b5c26c6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Flow 'volume_create_manager' (7bb19cee-fb5a-47e5-b828-6381df27eea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-71f4a46a-5a3d-49d1-b3f7-0597b10e5297 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Created volume successfully.
Jul 07 03:43:53 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:43:53 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8" returned: 0 in 1.143s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e5b05b2-938f-40a9-898a-ad8785c06c82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaa86f7-d653-4520-b902-4a853dfdd7eb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec231da-2b09-4e07-b9fb-225b3ca5a37a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:53 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82
Jul 07 03:43:53 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:53 devstack sudo[98428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD
Jul 07 03:43:53 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:54 devstack sudo[98434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:54 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:54 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82" returned: 0 in 1.032s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:54 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8
Jul 07 03:43:54 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:54 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD" returned: 0 in 1.085s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b is fetched for user 916ea61283cc4b288dbfea2754b181d3. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb5d563-e879-4dc9-bdaf-08b1d89dbbb1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:55 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD
Jul 07 03:43:55 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:55 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-729c3292-ccdb-41bc-bd4b-bda2688f9a09 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Retype volume completed successfully.
Jul 07 03:43:55 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8" returned: 0 in 0.891s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:55 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8
Jul 07 03:43:55 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:55 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1604665832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77071b3-2bbf-4f7c-b182-5658f6a115bf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:52Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Creating volume b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:55 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:55 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1073741824
Jul 07 03:43:55 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "cinder-7b9f1045-7ee6-4842-83a8-fdfdf4c87051-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "cinder-7b9f1045-7ee6-4842-83a8-fdfdf4c87051-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "cinder-quobyte-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "cinder-quobyte-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a6f53-48cc-436a-bd5e-75d54ad77395]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:56 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051
Jul 07 03:43:56 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:56 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82.22721506-392b-49ee-b03e-08127b42d2f8" returned: 0 in 0.820s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-22721506-392b-49ee-b03e-08127b42d2f8" released by "_delete_snapshot" :: held 4.117s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" released by "delete_snapshot" :: held 4.187s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['efe05cfd-8c38-43c3-bed2-884dc194ed2d', '9b53244c-1719-4d64-a46b-9a2a723b806e', '49d99228-0873-4214-9895-41f030a356f1', '64ff28af-8c67-4d82-9aef-8d640ee889dd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Delete snapshot completed successfully.
Jul 07 03:43:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6bf72759-345a-4ea1-8cf4-65655d6bf32e tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-22721506-392b-49ee-b03e-08127b42d2f8-delete_snapshot" released by "delete_snapshot" :: held 4.488s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:57 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1073741824" returned: 0 in 1.167s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:57 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:43:57 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:57 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" returned: 0 in 1.067s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:57 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051
Jul 07 03:43:57 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:57 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Attempting download of bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume b77071b3-2bbf-4f7c-b182-5658f6a115bf. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:43:57 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "cinder-quobyte-7b9f1045-7ee6-4842-83a8-fdfdf4c87051" released by "delete_volume" :: held 1.831s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc1dff-eae5-42d2-b1bc-3ed33afc7dc3]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:57 devstack cinder-volume[86955]: WARNING cinder.quota [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:43:57 devstack cinder-volume[86955]: WARNING cinder.quota [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:43:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Created reservations ['ae6f8d05-4d70-4e8a-858e-7d82eb44cedf', '48b7feac-8c46-462f-aa83-1632d787f638', '33554246-3273-49e0-bee0-ad3726b24abe', '8c3cf37f-209b-4190-9e9b-fe6659ccb588'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:43:58 devstack sudo[98474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f
Jul 07 03:43:58 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:58 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:43:58 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (ce6fcb45-0c81-4515-88a2-18049ea7d269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e24cbf-3928-4dde-86e6-77032795f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e24cbf-3928-4dde-86e6-77032795f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313197860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ce589-2125-4b83-bb2a-2f8e87cbe07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:58Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86017518-7771-40d2-a1f1-33bf9a040359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86017518-7771-40d2-a1f1-33bf9a040359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae0ee1f-94cd-4bb6-bf01-94b298c1ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eae0ee1f-94cd-4bb6-bf01-94b298c1ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557ce589-2125-4b83-bb2a-2f8e87cbe07b', 'volume_name': 'volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226102f9-03d2-433c-9cb6-c283d697b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226102f9-03d2-433c-9cb6-c283d697b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd04d9c-1d95-4501-9f16-6285c561d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:43:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Volume 557ce589-2125-4b83-bb2a-2f8e87cbe07b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b', 'volume_size': 1}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313197860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557ce589-2125-4b83-bb2a-2f8e87cbe07b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:43:58Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Creating volume 557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:43:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:43:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:58 devstack sudo[98478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b 1073741824
Jul 07 03:43:58 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:59 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f" returned: 0 in 1.126s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:59 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.031s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:43:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Deleted volume successfully.
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a22b4e25-ae32-4d2f-ae6c-aaeaf20596f4 tempest-VolumeRetypeWithoutMigrationTest-73683256 None] Lock "cinder-7b9f1045-7ee6-4842-83a8-fdfdf4c87051-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:43:59 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f
Jul 07 03:43:59 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:59 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b 1073741824" returned: 0 in 1.160s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:43:59 devstack sudo[98490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:43:59 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:43:59 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f" returned: 1 in 0.947s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b_vsin6p3f' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7dfa9-c71b-4e2c-a5ac-5be83c54b04a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:43:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:00 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD
Jul 07 03:44:00 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:00 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.864s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd04d9c-1d95-4501-9f16-6285c561d049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f694636-8d51-4bb8-9d8d-fa0078796ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Volume volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b (557ce589-2125-4b83-bb2a-2f8e87cbe07b): created successfully
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f694636-8d51-4bb8-9d8d-fa0078796ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (ce6fcb45-0c81-4515-88a2-18049ea7d269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7941dc62-a532-47aa-ac46-42863f7ac41d tempest-VolumesSnapshotTestJSON-381061207 None] Created volume successfully.
Jul 07 03:44:00 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] bce35279-0f3f-4049-8975-1c6590eb177b was qcow2, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:44:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:00 devstack sudo[98500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:00 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Creating offline snapshot db0d96d0-57df-499c-946f-60e16a33661d of volume 557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:44:01 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb3602e-5879-4503-92a6-26f4a380ff3c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:02 devstack sudo[98508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:02 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:02 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 1.124s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:03 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d 1G
Jul 07 03:44:03 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:03 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 0 in 2.469s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:03 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_20760ghodevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:44:03 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Converted 112.00 MB image at 45.33 MB/s
Jul 07 03:44:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:03 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1G
Jul 07 03:44:03 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:04 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d 1G" returned: 0 in 1.069s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:04 devstack sudo[98524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:04 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf 1G" returned: 0 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c90ef6-a16c-4318-8b4b-6f35d013a331]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:04 devstack sudo[98526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:04 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:04 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.850s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d is being set with open permissions: ugo+rw
Jul 07 03:44:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:04 devstack sudo[98532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:04 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:05 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Flow 'volume_create_manager' (eea0573a-0736-4f5e-9433-cc35e22770fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3804224b-d369-4acd-b29b-cd545fd17096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 0 in 1.043s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3804224b-d369-4acd-b29b-cd545fd17096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-923488765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2029e5ee-2038-41eb-9ce4-d342c62dbbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b531f4ae0f56453a9dd080652a7c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:05Z,use_quota=True,user_id='a11dce65389f40f59b68b413e5f5930b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b57183-92f6-4560-b23d-c13477a845dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b57183-92f6-4560-b23d-c13477a845dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22ff72d-6976-41a9-9384-6cd1e186baf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f22ff72d-6976-41a9-9384-6cd1e186baf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2029e5ee-2038-41eb-9ce4-d342c62dbbe6', 'volume_name': 'volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4741b8-0557-4a1b-8768-fc5576fef7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4741b8-0557-4a1b-8768-fc5576fef7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cafb76-3d0c-4bb3-80af-fc33b5e7c602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Volume 2029e5ee-2038-41eb-9ce4-d342c62dbbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6', 'volume_size': 1}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:05 devstack sudo[98536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:05 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:05 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.853s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:05 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info
Jul 07 03:44:05 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:06 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 1 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Downloaded image bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume b77071b3-2bbf-4f7c-b182-5658f6a115bf successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b for user 916ea61283cc4b288dbfea2754b181d3 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Marking volume b77071b3-2bbf-4f7c-b182-5658f6a115bf as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Copying metadata from image bce35279-0f3f-4049-8975-1c6590eb177b to b77071b3-2bbf-4f7c-b182-5658f6a115bf. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Creating volume glance metadata for volume b77071b3-2bbf-4f7c-b182-5658f6a115bf backed by image bce35279-0f3f-4049-8975-1c6590eb177b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac556d5-99aa-4500-813e-b1b1f4fc1636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f04e900>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5f14f7-abf9-4318-8b96-79fc3ca2723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Volume volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf (b77071b3-2bbf-4f7c-b182-5658f6a115bf): created successfully
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5f14f7-abf9-4318-8b96-79fc3ca2723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (a1e683cf-4dad-487c-865b-ac2188b09c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7422f62d-53cb-490f-b88c-4cdadf790bac tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:44:06 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info is being set with open permissions: ugo+rw
Jul 07 03:44:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:06 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info
Jul 07 03:44:06 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:07 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.info" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.354s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-923488765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2029e5ee-2038-41eb-9ce4-d342c62dbbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b531f4ae0f56453a9dd080652a7c2847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:05Z,use_quota=True,user_id='a11dce65389f40f59b68b413e5f5930b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Creating volume 2029e5ee-2038-41eb-9ce4-d342c62dbbe6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:07 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 1073741824
Jul 07 03:44:07 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6e68c539-3ce7-4e2b-8f33-598848770c8a tempest-VolumesSnapshotTestJSON-381061207 None] Create snapshot completed successfully
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (51c973e5-7006-42c9-855b-7cdd1717b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10dac99-1e02-43c4-b3c2-b10a0bcdd87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d10dac99-1e02-43c4-b3c2-b10a0bcdd87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1222125576',display_name='tempest-VolumesGetTest-Volume-1474922195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451fa3f3-eac9-4e9e-8b32-a12367849756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:07Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6a3a97-fee4-4b2e-842c-a4727cd16864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6a3a97-fee4-4b2e-842c-a4727cd16864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0925e4c-2246-4f67-8019-13e3203a24aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0925e4c-2246-4f67-8019-13e3203a24aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '451fa3f3-eac9-4e9e-8b32-a12367849756', 'volume_name': 'volume-451fa3f3-eac9-4e9e-8b32-a12367849756', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71f08ee-2f04-4e49-82b2-01d91c5ded01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71f08ee-2f04-4e49-82b2-01d91c5ded01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d051763e-3a87-4d9d-be00-73f2fcac9e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Volume 451fa3f3-eac9-4e9e-8b32-a12367849756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-451fa3f3-eac9-4e9e-8b32-a12367849756', 'volume_size': 1}
Jul 07 03:44:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:08 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 1073741824" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:08 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6
Jul 07 03:44:08 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (f206faea-6edd-490a-89fd-7f6cd8884e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577e0db-dc3b-419c-8c25-12bf2ec3d935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6577e0db-dc3b-419c-8c25-12bf2ec3d935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-280655948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73903cd5-9271-454c-aba0-8b2def51455e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=db0d96d0-57df-499c-946f-60e16a33661d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:09Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d2ae8-3347-4e68-9ff3-4d48c47d7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (073d2ae8-3347-4e68-9ff3-4d48c47d7baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b6b6d-d348-4aec-88d1-b7f30d973d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (770b6b6d-d348-4aec-88d1-b7f30d973d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73903cd5-9271-454c-aba0-8b2def51455e', 'volume_name': 'volume-73903cd5-9271-454c-aba0-8b2def51455e', 'volume_size': 2, 'snapshot_id': 'db0d96d0-57df-499c-946f-60e16a33661d'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37331a69-85f1-463e-8f4c-31a87337b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37331a69-85f1-463e-8f4c-31a87337b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c562864-4a6c-4c67-adf8-435ae91063d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Volume 73903cd5-9271-454c-aba0-8b2def51455e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73903cd5-9271-454c-aba0-8b2def51455e', 'volume_size': 2, 'snapshot_id': 'db0d96d0-57df-499c-946f-60e16a33661d'}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" returned: 0 in 0.688s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.382s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1222125576',display_name='tempest-VolumesGetTest-Volume-1474922195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=451fa3f3-eac9-4e9e-8b32-a12367849756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eb29872c7cb44ee9e098975be1d1714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:07Z,use_quota=True,user_id='916ea61283cc4b288dbfea2754b181d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Creating volume 451fa3f3-eac9-4e9e-8b32-a12367849756 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cafb76-3d0c-4bb3-80af-fc33b5e7c602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack sudo[98558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 1073741824
Jul 07 03:44:08 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ac6dd3-f6a2-4fc8-a96d-3618baa3c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Volume volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 (2029e5ee-2038-41eb-9ce4-d342c62dbbe6): created successfully
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ac6dd3-f6a2-4fc8-a96d-3618baa3c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Flow 'volume_create_manager' (eea0573a-0736-4f5e-9433-cc35e22770fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e22847a1-987d-47cd-a368-399a3300208d tempest-VolumesServicesTestJSON-560031159 None] Created volume successfully.
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Acquiring lock "cinder-2029e5ee-2038-41eb-9ce4-d342c62dbbe6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "cinder-2029e5ee-2038-41eb-9ce4-d342c62dbbe6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Acquiring lock "cinder-quobyte-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:09 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "cinder-quobyte-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 1073741824" returned: 0 in 0.878s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9b05ec-e6d0-4d84-abcb-f078a862c64a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:09 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756
Jul 07 03:44:09 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:09 devstack sudo[98565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6
Jul 07 03:44:09 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:10 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.580s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d-73903cd5-9271-454c-aba0-8b2def51455e" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d051763e-3a87-4d9d-be00-73f2fcac9e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-451fa3f3-eac9-4e9e-8b32-a12367849756', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a90a3bd-b6e0-45ca-8d84-5aa64d523a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d-73903cd5-9271-454c-aba0-8b2def51455e" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Creating volume 73903cd5-9271-454c-aba0-8b2def51455e from snapshot db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Volume volume-451fa3f3-eac9-4e9e-8b32-a12367849756 (451fa3f3-eac9-4e9e-8b32-a12367849756): created successfully
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a90a3bd-b6e0-45ca-8d84-5aa64d523a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Flow 'volume_create_manager' (51c973e5-7006-42c9-855b-7cdd1717b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:10 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] snapshot: db0d96d0-57df-499c-946f-60e16a33661d, volume: 73903cd5-9271-454c-aba0-8b2def51455e,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:44:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c805f587-a81a-4d01-a744-a45a8356b1a6 tempest-VolumesGetTest-1634979250 None] Created volume successfully.
Jul 07 03:44:10 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6
Jul 07 03:44:10 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c014cf0-d111-4c6f-9089-f7062270f671]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:10 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:10 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:11 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "cinder-quobyte-2029e5ee-2038-41eb-9ce4-d342c62dbbe6" released by "delete_volume" :: held 1.477s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Created reservations ['71e24c75-0122-41ee-aaee-1031fa7356d6', 'e5665bde-873a-479c-8a42-bbc7d64ab678', '43882d23-9e26-451a-a58c-c4b3335b5c7d', 'e3767970-e693-44e0-a3b4-a784e3fabd1d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:11 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:11 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:11 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.822s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e8b3d-b902-458e-b0a5-0b57c6be8369]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:11 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:11 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-451fa3f3-eac9-4e9e-8b32-a12367849756-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "cinder-451fa3f3-eac9-4e9e-8b32-a12367849756-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-451fa3f3-eac9-4e9e-8b32-a12367849756" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-451fa3f3-eac9-4e9e-8b32-a12367849756" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b4a07e-a9f2-43cd-9077-824d4c54643f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:11 devstack sudo[98585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756
Jul 07 03:44:11 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:11 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.702s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Deleted volume successfully.
Jul 07 03:44:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bfec48b9-c245-4551-b694-4df847e915a4 tempest-VolumesServicesTestJSON-560031159 None] Lock "cinder-2029e5ee-2038-41eb-9ce4-d342c62dbbe6-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:12 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.884s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:12 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:44:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:12 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e
Jul 07 03:44:12 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:12 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756" returned: 0 in 0.928s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:12 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756
Jul 07 03:44:12 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:13 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-451fa3f3-eac9-4e9e-8b32-a12367849756" returned: 0 in 0.888s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-451fa3f3-eac9-4e9e-8b32-a12367849756" released by "delete_volume" :: held 1.885s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Created reservations ['83467d21-581e-42f2-bce0-9c2f5e8a1e31', 'a513e0d4-864a-40f1-acc9-4c652cae4e8e', '97a01009-a38e-4de1-a30e-951d1d072a67', '16deddea-e43e-4e7b-8df6-fc964685ac49'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:14 devstack sudo[98610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:14 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:15 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:15 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-b77071b3-2bbf-4f7c-b182-5658f6a115bf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "cinder-b77071b3-2bbf-4f7c-b182-5658f6a115bf-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Acquiring lock "cinder-quobyte-b77071b3-2bbf-4f7c-b182-5658f6a115bf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-b77071b3-2bbf-4f7c-b182-5658f6a115bf" acquired by "delete_volume" :: waited 0.066s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b8372-7959-4725-8462-edd18d70dab2]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:16 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:16 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:16 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 2.113s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:44:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-900b59fd-6c39-404d-a9b9-3ccb0cfdcf0f tempest-VolumesGetTest-1634979250 None] Lock "cinder-451fa3f3-eac9-4e9e-8b32-a12367849756-delete_volume" released by "delete_volume" :: held 4.965s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:17 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 2.097s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:17 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:17 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:44:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:44:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:44:18 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 0 in 2.028s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:18 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:18 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:18 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e" returned: 0 in 6.054s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b083f7-7db4-4f75-a242-2ce6e206d644]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:18 devstack sudo[98626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:18 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:18 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 1 in 0.851s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:44:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:18 devstack sudo[98632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf
Jul 07 03:44:18 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:19 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.998s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:44:19 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Converted 1024.00 MB image at 169.10 MB/s
Jul 07 03:44:19 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e is being set with open permissions: ugo+rw
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:19 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e
Jul 07 03:44:19 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:19 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b77071b3-2bbf-4f7c-b182-5658f6a115bf" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "cinder-quobyte-b77071b3-2bbf-4f7c-b182-5658f6a115bf" released by "delete_volume" :: held 3.737s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Created reservations ['b670062f-22fb-43fb-a2d6-3b115da2a6b3', 'be4c9430-9bf7-4fdf-834b-4524ccf90f5c', '1d8834f4-32a7-4f2a-b4b0-24f254443e98', '14bad7ee-3653-4cfc-bc80-e8527760cb22'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:19 devstack sudo[98640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:19 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:19 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e" returned: 0 in 0.697s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" released by "_copy_volume_from_snapshot" :: held 9.572s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d-73903cd5-9271-454c-aba0-8b2def51455e" released by "_create_volume_from_snapshot" :: held 9.634s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.667s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c562864-4a6c-4c67-adf8-435ae91063d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73903cd5-9271-454c-aba0-8b2def51455e', 'volume_size': 2, 'snapshot_id': 'db0d96d0-57df-499c-946f-60e16a33661d'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f497a9ca-d903-4231-a3d0-39c5e5142fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Volume volume-73903cd5-9271-454c-aba0-8b2def51455e (73903cd5-9271-454c-aba0-8b2def51455e): created successfully
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f497a9ca-d903-4231-a3d0-39c5e5142fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (f206faea-6edd-490a-89fd-7f6cd8884e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-00f20ac8-786d-49fa-b6d0-f7122738e7d0 tempest-VolumesSnapshotTestJSON-381061207 None] Created volume successfully.
Jul 07 03:44:20 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.707s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Deleted volume successfully.
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-912b1c7b-7611-484c-8115-625adb0cf453 tempest-VolumesGetTest-1634979250 None] Lock "cinder-b77071b3-2bbf-4f7c-b182-5658f6a115bf-delete_volume" released by "delete_volume" :: held 4.800s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-73903cd5-9271-454c-aba0-8b2def51455e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-73903cd5-9271-454c-aba0-8b2def51455e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3180eb9a-8d11-4a3c-be44-6d6e9e605b50]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:21 devstack sudo[98646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e
Jul 07 03:44:21 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:21 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e" returned: 0 in 0.843s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:21 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e
Jul 07 03:44:21 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:22 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-73903cd5-9271-454c-aba0-8b2def51455e" returned: 0 in 0.722s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-73903cd5-9271-454c-aba0-8b2def51455e" released by "delete_volume" :: held 1.621s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['b958c386-e198-49da-80de-4c4d0fae7e47', '15d2dacf-272e-4215-831e-4dcf7e778efb', '05b3e317-6aac-4c4f-a70a-9c9bd210ed8f', 'c78db7ea-e539-4cf6-a21b-47f6370c9494'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:22 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:22 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-db0d96d0-57df-499c-946f-60e16a33661d-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-db0d96d0-57df-499c-946f-60e16a33661d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Deleting offline snapshot db0d96d0-57df-499c-946f-60e16a33661d of volume 557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] snapshot_file for this snap is: volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d272377-d2cb-4e4d-9da8-d9b572a35cf9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Flow 'volume_create_manager' (9e914b11-72cd-4db9-b4d6-3ad4d3970ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99f33bc-cb39-4a0d-9f9a-bc0eb865e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:23 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.782s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Deleted volume successfully.
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99f33bc-cb39-4a0d-9f9a-bc0eb865e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2013578510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371451b7-96b3-4f23-816f-7b01ef2b8d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0f21a2d7e44c01970ceb5e24de6f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:23Z,use_quota=True,user_id='e82a920b47ff4a1f9cd3bb87ae331eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbd2a6c-1df6-4bbf-a0f5-9ae1eef3023b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:23 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:23 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbd2a6c-1df6-4bbf-a0f5-9ae1eef3023b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869f2c75-5742-4237-9ad4-94d77636cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (869f2c75-5742-4237-9ad4-94d77636cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371451b7-96b3-4f23-816f-7b01ef2b8d6d', 'volume_name': 'volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cc72fb-d4f1-4f12-9234-10870f79a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cc72fb-d4f1-4f12-9234-10870f79a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e907b9-b097-4dd7-9b11-2638c1d5b1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d', 'volume_size': 1}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2013578510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371451b7-96b3-4f23-816f-7b01ef2b8d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec0f21a2d7e44c01970ceb5e24de6f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:23Z,use_quota=True,user_id='e82a920b47ff4a1f9cd3bb87ae331eaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Creating volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:23 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d 1073741824
Jul 07 03:44:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf0aa2fb-138e-451a-94c1-59161d19324a tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-73903cd5-9271-454c-aba0-8b2def51455e-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:23 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:24 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.900s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acc27e7-7f6a-418e-a661-7c7a102824ee]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:24 devstack sudo[98668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:24 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:24 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d 1073741824" returned: 0 in 0.939s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:24 devstack sudo[98670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d
Jul 07 03:44:24 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:25 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.841s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:25 devstack sudo[98676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:25 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:25 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d" returned: 0 in 0.743s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e907b9-b097-4dd7-9b11-2638c1d5b1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa6520c-1a66-4c3c-970b-edff8a21726a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Volume volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d (371451b7-96b3-4f23-816f-7b01ef2b8d6d): created successfully
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa6520c-1a66-4c3c-970b-edff8a21726a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Flow 'volume_create_manager' (9e914b11-72cd-4db9-b4d6-3ad4d3970ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cbc84e01-bc32-4ed1-b82a-e796498a2f9c tempest-VolumesSnapshotListTestJSON-545758037 None] Created volume successfully.
Jul 07 03:44:26 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:26 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d
Jul 07 03:44:26 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:26 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b.db0d96d0-57df-499c-946f-60e16a33661d" returned: 0 in 0.712s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-db0d96d0-57df-499c-946f-60e16a33661d" released by "_delete_snapshot" :: held 3.454s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" released by "delete_snapshot" :: held 3.486s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Creating offline snapshot 1a583f52-2b15-468a-bdda-5111030967c7 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f886b5-d76b-442d-832a-19746c4913c0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['7b0cb92d-aee1-4d0f-bb12-eb52ed2c602a', '870ad81e-d848-427d-af2a-d153570d875e', '824ae730-c504-406a-bb60-2fd43bded491', 'de4a5cb6-4820-4aca-930b-4da91101bb22'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Delete snapshot completed successfully.
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2e25e9ef-abfc-42f7-905b-26dd4afbeb50 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-db0d96d0-57df-499c-946f-60e16a33661d-delete_snapshot" released by "delete_snapshot" :: held 3.668s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:27 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d
Jul 07 03:44:27 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-557ce589-2125-4b83-bb2a-2f8e87cbe07b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-557ce589-2125-4b83-bb2a-2f8e87cbe07b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:27 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d" returned: 0 in 0.891s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:27 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 1G
Jul 07 03:44:27 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32de14-01fc-4829-816c-d50e9dd89921]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:28 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:28 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:28 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 1G" returned: 0 in 0.837s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:28 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:28 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:28 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.819s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:28 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b
Jul 07 03:44:28 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:29 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.849s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:29 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 is being set with open permissions: ugo+rw
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:29 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-557ce589-2125-4b83-bb2a-2f8e87cbe07b" returned: 0 in 0.824s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:29 devstack sudo[98709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:29 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-557ce589-2125-4b83-bb2a-2f8e87cbe07b" released by "delete_volume" :: held 1.728s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['0590e733-93d4-466d-b25a-a31d92499fe1', 'cfef64b4-dda0-4749-803a-0fa69bec73bd', 'a8412ad3-228c-4635-b2e8-d246f60ec954', 'e8f57330-37c4-44ef-8868-7c232f41d87c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:29 devstack sudo[98711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:29 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:30 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:30 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:30 devstack sudo[98715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info
Jul 07 03:44:30 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Deleted volume successfully.
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c7fa62c6-1bbf-405b-a31a-68003115f2d8 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-557ce589-2125-4b83-bb2a-2f8e87cbe07b-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (cf243b8d-ff80-4fed-b4e0-8f91bf4cda1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90410225-835a-43ac-b3af-c4822a2554d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90410225-835a-43ac-b3af-c4822a2554d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1003825687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8663335-ff28-4653-adae-d5fc55e50116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:31Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5d4dbd-7e62-4e3c-b974-b405d6ad58f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b5d4dbd-7e62-4e3c-b974-b405d6ad58f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b22751-b237-427d-b1af-3d0236221abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b22751-b237-427d-b1af-3d0236221abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8663335-ff28-4653-adae-d5fc55e50116', 'volume_name': 'volume-e8663335-ff28-4653-adae-d5fc55e50116', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c74a291-f83d-4aa5-b963-a273469f6c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c74a291-f83d-4aa5-b963-a273469f6c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c81489-8fd6-407d-b4ce-dd65e078960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Volume e8663335-ff28-4653-adae-d5fc55e50116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8663335-ff28-4653-adae-d5fc55e50116', 'volume_size': 1}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:31 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info" returned: 0 in 0.789s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info is being set with open permissions: ugo+rw
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:31 devstack sudo[98718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info
Jul 07 03:44:31 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:31 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.info" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1003825687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8663335-ff28-4653-adae-d5fc55e50116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:31Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Creating volume e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:31 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:44:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:31 devstack sudo[98721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 1073741824
Jul 07 03:44:31 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a3cd93fb-e00b-4a44-8034-f60cf5543bec tempest-VolumesSnapshotListTestJSON-545758037 None] Create snapshot completed successfully
Jul 07 03:44:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:32 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 1073741824" returned: 0 in 0.886s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:32 devstack sudo[98727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:44:32 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:33 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.187s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=140,cinder:SELECT=130,cinder:INSERT=45,cinder:DELETE=9 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=137,cinder:SELECT=111,cinder:INSERT=38,cinder:DELETE=15 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c81489-8fd6-407d-b4ce-dd65e078960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8663335-ff28-4653-adae-d5fc55e50116', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e2d7a0-64bb-4af6-ba15-23b53739b738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Creating offline snapshot f954badd-6300-4ba6-b532-3b690a689057 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:44:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Volume volume-e8663335-ff28-4653-adae-d5fc55e50116 (e8663335-ff28-4653-adae-d5fc55e50116): created successfully
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e2d7a0-64bb-4af6-ba15-23b53739b738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (cf243b8d-ff80-4fed-b4e0-8f91bf4cda1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3943d5fc-5e0e-426e-9680-508770927fad]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e402204f-21ac-4623-ad9f-6ab5213ea19b tempest-VolumesSnapshotTestJSON-381061207 None] Created volume successfully.
Jul 07 03:44:33 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:33 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:34 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.918s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:34 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 1G
Jul 07 03:44:34 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:35 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 1G" returned: 0 in 0.874s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:35 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:35 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:36 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.742s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:36 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 is being set with open permissions: ugo+rw
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:36 devstack sudo[98746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:36 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:36 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.707s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.395s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.671s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Creating offline snapshot b6f12e6e-ebbd-4c32-89f6-944e2fca3122 of volume e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:44:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5cd576d3-ec9b-4e87-9ee8-d48615373c09 tempest-VolumesSnapshotListTestJSON-545758037 None] Create snapshot completed successfully
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d8ace2-d71b-4561-9097-a49170c72689]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:37 devstack sudo[98749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:44:37 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:37 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.839s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:37 devstack sudo[98754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 1G
Jul 07 03:44:37 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:38 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 1G" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8663335-ff28-4653-adae-d5fc55e50116 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:38 devstack sudo[98760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8663335-ff28-4653-adae-d5fc55e50116 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:44:38 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:39 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8663335-ff28-4653-adae-d5fc55e50116 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 is being set with open permissions: ugo+rw
Jul 07 03:44:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:39 devstack sudo[98766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:44:39 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:40 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:40 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info
Jul 07 03:44:40 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:41 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:41 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info is being set with open permissions: ugo+rw
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:41 devstack sudo[98808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info
Jul 07 03:44:41 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:41 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.info" returned: 0 in 0.702s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.964s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.134s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Creating offline snapshot 2d5767bd-25fa-4922-9255-8c2e108d9860 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:44:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[690c607a-fea4-421b-b0b9-275169a3fb7b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:42 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8c5e4c30-3afa-4c98-9cea-aae8f61d7220 tempest-VolumesSnapshotTestJSON-381061207 None] Create snapshot completed successfully
Jul 07 03:44:42 devstack sudo[98811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:42 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:42 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.959s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:43 devstack sudo[98816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 1G
Jul 07 03:44:43 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (e7f202c2-0044-460c-a454-738188dc1d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b96ed6d-a721-4c7b-b418-a1aa6b61dbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b96ed6d-a721-4c7b-b418-a1aa6b61dbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1611014143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b890e94-d27f-4760-98d4-4c29d9f716cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15fac86149f4dcd9ab842f94686e4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b6f12e6e-ebbd-4c32-89f6-944e2fca3122,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:44:43Z,use_quota=True,user_id='7f5d6627475e445eaee73ef159b87db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af4c30-d07a-4894-bebf-d231f6aab971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29af4c30-d07a-4894-bebf-d231f6aab971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b3fd33-c106-4467-98eb-253a56afc95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b3fd33-c106-4467-98eb-253a56afc95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b890e94-d27f-4760-98d4-4c29d9f716cd', 'volume_name': 'volume-6b890e94-d27f-4760-98d4-4c29d9f716cd', 'volume_size': 1, 'snapshot_id': 'b6f12e6e-ebbd-4c32-89f6-944e2fca3122'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0621ad8-572a-4eaa-8318-953ee60d440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0621ad8-572a-4eaa-8318-953ee60d440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd7ccca-a10f-409d-8006-0dd6b7e53361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Volume 6b890e94-d27f-4760-98d4-4c29d9f716cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b890e94-d27f-4760-98d4-4c29d9f716cd', 'volume_size': 1, 'snapshot_id': 'b6f12e6e-ebbd-4c32-89f6-944e2fca3122'}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:43 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 1G" returned: 0 in 0.966s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:43 devstack sudo[98822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860
Jul 07 03:44:43 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:44 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:44 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 is being set with open permissions: ugo+rw
Jul 07 03:44:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:44 devstack sudo[98831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860
Jul 07 03:44:44 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:45 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860" returned: 0 in 0.652s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.474s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.943s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-6b890e94-d27f-4760-98d4-4c29d9f716cd" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-6b890e94-d27f-4760-98d4-4c29d9f716cd" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Creating volume 6b890e94-d27f-4760-98d4-4c29d9f716cd from snapshot b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-87adbdf1-4ced-47d1-a717-1dee62c6da16 tempest-VolumesSnapshotListTestJSON-545758037 None] Create snapshot completed successfully
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] snapshot: b6f12e6e-ebbd-4c32-89f6-944e2fca3122, volume: 6b890e94-d27f-4760-98d4-4c29d9f716cd,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647d59a-bbd8-4991-9851-75adbedc913c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:45 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:44:45 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:46 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.803s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8663335-ff28-4653-adae-d5fc55e50116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca93a8-9542-47e9-ac9b-2567536b2555]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:46 devstack sudo[98839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:44:46 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-2d5767bd-25fa-4922-9255-8c2e108d9860-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-2d5767bd-25fa-4922-9255-8c2e108d9860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-2d5767bd-25fa-4922-9255-8c2e108d9860" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-2d5767bd-25fa-4922-9255-8c2e108d9860" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Deleting offline snapshot 2d5767bd-25fa-4922-9255-8c2e108d9860 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] snapshot_file for this snap is: volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf5ce86-0345-4ebc-9a20-b1f6045793d3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:47 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.821s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:47 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860
Jul 07 03:44:47 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:47 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd
Jul 07 03:44:47 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:47 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be67856-a187-4bed-964f-9997fe0c38f9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:48 devstack sudo[98855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:48 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:49 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 1.153s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:49 devstack sudo[98868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860
Jul 07 03:44:49 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:51 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860" returned: 0 in 2.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:51 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860
Jul 07 03:44:51 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:53 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.2d5767bd-25fa-4922-9255-8c2e108d9860" returned: 0 in 1.305s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:53 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd" returned: 0 in 5.985s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-2d5767bd-25fa-4922-9255-8c2e108d9860" released by "_delete_snapshot" :: held 6.119s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" released by "delete_snapshot" :: held 6.154s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6300c-3a19-4013-9bb3-41b2a5fc1955]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Created reservations ['505473b2-1b87-46b0-8da3-79231bf85c2e', '562929ed-7190-4f6d-9ff1-fb0288b46403', '9527d82e-cb78-4a50-a94f-12701671673f', '0a2423d9-0d7e-4685-9816-5f43b7b1a0b0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Delete snapshot completed successfully.
Jul 07 03:44:53 devstack sudo[98899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:44:53 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07ac8140-42ee-4814-8d94-ad48e350c3e4 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-2d5767bd-25fa-4922-9255-8c2e108d9860-delete_snapshot" released by "delete_snapshot" :: held 6.322s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-f954badd-6300-4ba6-b532-3b690a689057-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-f954badd-6300-4ba6-b532-3b690a689057-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-f954badd-6300-4ba6-b532-3b690a689057" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-f954badd-6300-4ba6-b532-3b690a689057" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Deleting offline snapshot f954badd-6300-4ba6-b532-3b690a689057 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] snapshot_file for this snap is: volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e8b45-9cd5-48d5-872f-4d09f57b662d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:53 devstack sudo[98902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:53 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:54 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 1.068s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:44:54 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Converted 1024.00 MB image at 171.06 MB/s
Jul 07 03:44:54 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd is being set with open permissions: ugo+rw
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:54 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd
Jul 07 03:44:54 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:54 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.822s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b020a346-4ed9-4635-bd71-51f734dafdb4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:54 devstack sudo[98914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:54 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:54 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd" returned: 0 in 0.687s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" released by "_copy_volume_from_snapshot" :: held 9.474s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-6b890e94-d27f-4760-98d4-4c29d9f716cd" released by "_create_volume_from_snapshot" :: held 9.510s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.540s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd7ccca-a10f-409d-8006-0dd6b7e53361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b890e94-d27f-4760-98d4-4c29d9f716cd', 'volume_size': 1, 'snapshot_id': 'b6f12e6e-ebbd-4c32-89f6-944e2fca3122'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55070a50-0687-4348-a073-e371b89cad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:44:55 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Volume volume-6b890e94-d27f-4760-98d4-4c29d9f716cd (6b890e94-d27f-4760-98d4-4c29d9f716cd): created successfully
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55070a50-0687-4348-a073-e371b89cad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Flow 'volume_create_manager' (e7f202c2-0044-460c-a454-738188dc1d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:44:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-51d51eb0-fb94-4f24-9b05-99c87944daa4 tempest-VolumesSnapshotTestJSON-381061207 None] Created volume successfully.
Jul 07 03:44:55 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.775s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:55 devstack sudo[98920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:55 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-6b890e94-d27f-4760-98d4-4c29d9f716cd-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-6b890e94-d27f-4760-98d4-4c29d9f716cd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cd433a-e73a-474c-b3c8-c42a24e93f7d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:55 devstack sudo[98922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd
Jul 07 03:44:55 devstack sudo[98922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:56 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.891s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:56 devstack sudo[98928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057
Jul 07 03:44:56 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:56 devstack sudo[98922]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd" returned: 0 in 0.846s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:56 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd
Jul 07 03:44:56 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:56 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.f954badd-6300-4ba6-b532-3b690a689057" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-f954badd-6300-4ba6-b532-3b690a689057" released by "_delete_snapshot" :: held 3.363s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" released by "delete_snapshot" :: held 3.395s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Created reservations ['75158656-2e32-42da-9087-25334b79f7aa', '8ec3bf59-c1b0-46d5-9177-f49dcd11e059', '6744404d-7e4e-4887-8cf3-594c6b30b133', '3e797dce-708e-43ab-969d-41effaa018dc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Delete snapshot completed successfully.
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-81d2a9be-4801-4c8a-a524-be8359ca8d17 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-f954badd-6300-4ba6-b532-3b690a689057-delete_snapshot" released by "delete_snapshot" :: held 3.550s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:57 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6b890e94-d27f-4760-98d4-4c29d9f716cd" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-6b890e94-d27f-4760-98d4-4c29d9f716cd" released by "delete_volume" :: held 1.821s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['f8127ff3-885b-4341-8f7d-149679f9bc0d', '04de5dc1-2a1b-4942-9cd6-1b17cdb3cd88', '32c68e74-1b8d-477d-9cf7-eeb88699934c', 'cf616170-441d-461f-8786-669993a52942'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:57 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:44:57 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-1a583f52-2b15-468a-bdda-5111030967c7-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-1a583f52-2b15-468a-bdda-5111030967c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-1a583f52-2b15-468a-bdda-5111030967c7" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-1a583f52-2b15-468a-bdda-5111030967c7" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Deleting offline snapshot 1a583f52-2b15-468a-bdda-5111030967c7 of volume 371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] snapshot_file for this snap is: volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f45aa-3479-46dc-8409-b82356e58f7c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Deleting offline snapshot b6f12e6e-ebbd-4c32-89f6-944e2fca3122 of volume e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] snapshot_file for this snap is: volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[afce0f2a-3bc7-4d7a-aaf0-dd72a710d890]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:58 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:58 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:58 devstack sudo[98986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:44:58 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:58 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:44:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Deleted volume successfully.
Jul 07 03:44:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc39f4a7-8009-47ca-9888-3a041810bba6 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-6b890e94-d27f-4760-98d4-4c29d9f716cd-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:44:59 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.895s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e079582d-8aa6-4f0c-93f7-01b7d87d41cd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:59 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.883s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8663335-ff28-4653-adae-d5fc55e50116(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[644a2315-049b-4f12-98fa-b3b9d85a0252]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:59 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d
Jul 07 03:44:59 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:59 devstack sudo[99017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:44:59 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:59 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d" returned: 0 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:44:59 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:44:59 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:44:59 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:44:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:00 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:45:00 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:00 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.808s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:00 devstack sudo[99040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7
Jul 07 03:45:00 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:00 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.864s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:00 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122
Jul 07 03:45:00 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:01 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d.1a583f52-2b15-468a-bdda-5111030967c7" returned: 0 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-1a583f52-2b15-468a-bdda-5111030967c7" released by "_delete_snapshot" :: held 3.462s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" released by "delete_snapshot" :: held 3.506s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:01 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116.b6f12e6e-ebbd-4c32-89f6-944e2fca3122" returned: 0 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Created reservations ['1789c690-9391-421c-869b-8dabf6dd85fd', '973182f6-f34b-445b-ae27-b608b8a14660', 'da77fb7f-44c1-4492-a4c0-6ced36483ed1', '7ccaff28-94ec-4c90-9fe3-6a4a97304ae0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-b6f12e6e-ebbd-4c32-89f6-944e2fca3122" released by "_delete_snapshot" :: held 3.489s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" released by "delete_snapshot" :: held 3.518s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Delete snapshot completed successfully.
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8eceed29-f835-4e87-9cd9-6e24ddc2124e tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-1a583f52-2b15-468a-bdda-5111030967c7-delete_snapshot" released by "delete_snapshot" :: held 3.763s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['a885d837-fc64-4d60-bb73-b87362eca66d', 'c3080721-35ba-4754-b4af-e579aded56d5', '05cf1ae1-8b8b-4855-b81c-0c1a0210f44d', 'b2199dd8-4a78-4e5a-8ae0-5682af51ae97'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Delete snapshot completed successfully.
Jul 07 03:45:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f5e92f78-11c3-4c70-90b9-c51b2ca4b09c tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-b6f12e6e-ebbd-4c32-89f6-944e2fca3122-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-371451b7-96b3-4f23-816f-7b01ef2b8d6d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-371451b7-96b3-4f23-816f-7b01ef2b8d6d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (38ca82f0-d8ab-4a8b-b069-4cd7aa16d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aea74f1-e022-4a42-a6ca-e84d3a4820b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aea74f1-e022-4a42-a6ca-e84d3a4820b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-178431538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9bd825-eccc-4ec1-b224-02663dac127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:02Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2a4a6-addb-448a-90d9-fac378b4466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed2a4a6-addb-448a-90d9-fac378b4466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698a1d62-2ad1-4b89-9e79-9952dc9efbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698a1d62-2ad1-4b89-9e79-9952dc9efbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9bd825-eccc-4ec1-b224-02663dac127e', 'volume_name': 'volume-fe9bd825-eccc-4ec1-b224-02663dac127e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c36ef-822c-4514-b82a-4c7d98219ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112c36ef-822c-4514-b82a-4c7d98219ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3e1c90-5b5b-43d3-9256-6e8036d48084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Volume fe9bd825-eccc-4ec1-b224-02663dac127e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9bd825-eccc-4ec1-b224-02663dac127e', 'volume_size': 1}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-178431538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe9bd825-eccc-4ec1-b224-02663dac127e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:02Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Creating volume fe9bd825-eccc-4ec1-b224-02663dac127e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:02 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" acquired by "delete_volume" :: waited 0.141s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:02 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e 1073741824
Jul 07 03:45:02 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-e8663335-ff28-4653-adae-d5fc55e50116-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f74535e-d387-4147-9d51-acee5992ae9a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-e8663335-ff28-4653-adae-d5fc55e50116-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fb83e-9631-43e2-b95a-1a54c5f71bb1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:02 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d
Jul 07 03:45:02 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:02 devstack sudo[99053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:45:02 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:03 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:03 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e 1073741824" returned: 0 in 0.955s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d" returned: 0 in 0.875s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:03 devstack sudo[99066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d
Jul 07 03:45:03 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:03 devstack sudo[99069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e
Jul 07 03:45:03 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:03 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.986s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:03 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116
Jul 07 03:45:03 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:04 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-371451b7-96b3-4f23-816f-7b01ef2b8d6d" returned: 0 in 0.763s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-quobyte-371451b7-96b3-4f23-816f-7b01ef2b8d6d" released by "delete_volume" :: held 1.739s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:04 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3e1c90-5b5b-43d3-9256-6e8036d48084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9bd825-eccc-4ec1-b224-02663dac127e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba0517-8faf-4e91-b3d7-f16409ffdbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Created reservations ['7b9830f8-fa5f-48de-93ee-c737534784ab', 'b1a0cf94-7def-4d19-ad70-801b8e47dd66', 'eaf229db-0564-498f-b6ac-02a489e8b0e1', '03ecc662-4db7-4db4-b279-e5b06262bea4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Volume volume-fe9bd825-eccc-4ec1-b224-02663dac127e (fe9bd825-eccc-4ec1-b224-02663dac127e): created successfully
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ba0517-8faf-4e91-b3d7-f16409ffdbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (38ca82f0-d8ab-4a8b-b069-4cd7aa16d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3971c48d-c9d0-4093-a3b7-61ea6322ed54 tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:04 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:04 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:04 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-e8663335-ff28-4653-adae-d5fc55e50116" returned: 0 in 0.774s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-e8663335-ff28-4653-adae-d5fc55e50116" released by "delete_volume" :: held 1.828s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['d9feefd2-1186-4112-ada1-d0ae604d667c', '6314d96a-8c34-4d28-be30-a188e7889fb2', '007618f6-8dd2-4d8e-aa03-fdf54cca1fce', '6a88a306-e5bf-48fa-a641-785a82ad3c3f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:04 devstack sudo[99078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:04 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-9e5b05b2-938f-40a9-898a-ad8785c06c82-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-9e5b05b2-938f-40a9-898a-ad8785c06c82-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e6dced-76a3-4d30-b7fb-933861e6bad8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:05 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.852s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Deleted volume successfully.
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5784475f-51ed-4f38-b10a-59761a6167b8 tempest-VolumesSnapshotListTestJSON-545758037 None] Lock "cinder-371451b7-96b3-4f23-816f-7b01ef2b8d6d-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:05 devstack sudo[99081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82
Jul 07 03:45:05 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa02408a-8aee-4534-aa68-495ae17ff15f tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa02408a-8aee-4534-aa68-495ae17ff15f tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e" acquired by "attach_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa02408a-8aee-4534-aa68-495ae17ff15f tempest-VolumesActionsTest-48038210 None] Attaching volume fe9bd825-eccc-4ec1-b224-02663dac127e to instance 2aa7b392-6ed4-4df5-b17e-6bdbd23c9ac3 at mountpoint /dev/vdb on host None.
Jul 07 03:45:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fa02408a-8aee-4534-aa68-495ae17ff15f tempest-VolumesActionsTest-48038210 None] Attach volume completed successfully.
Jul 07 03:45:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fa02408a-8aee-4534-aa68-495ae17ff15f tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e" released by "attach_volume" :: held 0.182s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:06 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.570s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:06 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Deleted volume successfully.
Jul 07 03:45:06 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82" returned: 0 in 1.103s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-25741ad9-50ff-4bbe-8785-6b993081b7c2 tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-e8663335-ff28-4653-adae-d5fc55e50116-delete_volume" released by "delete_volume" :: held 3.702s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:06 devstack sudo[99087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82
Jul 07 03:45:06 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Terminate volume connection completed successfully.
Jul 07 03:45:07 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e5b05b2-938f-40a9-898a-ad8785c06c82" returned: 0 in 0.909s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-quobyte-9e5b05b2-938f-40a9-898a-ad8785c06c82" released by "delete_volume" :: held 2.096s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Created reservations ['6f17ab5b-9704-406e-af0c-3dde477817cb', '9ea1d67c-d1f4-4b84-a8da-8ac6652b0da3', 'ddd231d5-8d9f-420e-816e-e20e1a17be51', '760cc5f0-d87a-4ba5-9801-9f8664623a4a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:07 devstack sudo[99090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:07 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Detaching volume fe9bd825-eccc-4ec1-b224-02663dac127e from instance 2aa7b392-6ed4-4df5-b17e-6bdbd23c9ac3.
Jul 07 03:45:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Detach volume completed successfully.
Jul 07 03:45:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e6cb83b6-5498-4c9c-83ab-7ca58aaf85e9 tempest-VolumesActionsTest-580120748 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:08 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.766s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Deleted volume successfully.
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-714eae70-0615-4dac-89c5-6ad1892ca8ca tempest-VolumesSnapshotTestJSON-381061207 None] Lock "cinder-9e5b05b2-938f-40a9-898a-ad8785c06c82-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b029c431-3eb7-4e31-9e8d-a3f43daa6ca3 tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b029c431-3eb7-4e31-9e8d-a3f43daa6ca3 tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b029c431-3eb7-4e31-9e8d-a3f43daa6ca3 tempest-VolumesActionsTest-48038210 None] Volume detach called, but volume not attached.
Jul 07 03:45:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b029c431-3eb7-4e31-9e8d-a3f43daa6ca3 tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-quobyte-fe9bd825-eccc-4ec1-b224-02663dac127e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "cinder-quobyte-fe9bd825-eccc-4ec1-b224-02663dac127e" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c9c9e-20a2-4d34-96d6-b89553f65d5d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:09 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e
Jul 07 03:45:09 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:10 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e" returned: 0 in 1.000s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:10 devstack sudo[99101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e
Jul 07 03:45:10 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:11 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fe9bd825-eccc-4ec1-b224-02663dac127e" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "cinder-quobyte-fe9bd825-eccc-4ec1-b224-02663dac127e" released by "delete_volume" :: held 1.934s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Created reservations ['216e4376-9567-4d57-99b3-1016340d0163', '0db2e635-d175-4266-baf8-f35b4d506ae5', 'bf49f889-f6f2-47bc-a345-83fcd6adaf54', '9bc50d4b-ebe0-4e98-9ca8-06ee77e9f5ae'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:11 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:11 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:12 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.108s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Deleted volume successfully.
Jul 07 03:45:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3c256134-4925-475e-8598-aa4c0710852b tempest-VolumesActionsTest-48038210 None] Lock "cinder-fe9bd825-eccc-4ec1-b224-02663dac127e-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:15 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:15 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:16 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.744s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:45:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:45:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:45:21 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=79,cinder:DELETE=7,cinder:SELECT=71,cinder:INSERT=18 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (2c07b3ae-fedc-47d1-a47b-1446ab658e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c186d-7a5a-4328-896d-9b58da3da0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9c186d-7a5a-4328-896d-9b58da3da0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216379512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e798874-d918-47cc-8e6a-fa30c6e6215d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:22Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77de3be4-65b1-4834-a704-6e313d3ddc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77de3be4-65b1-4834-a704-6e313d3ddc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aa2a60-25e1-4dca-b198-edb5bd20760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aa2a60-25e1-4dca-b198-edb5bd20760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e798874-d918-47cc-8e6a-fa30c6e6215d', 'volume_name': 'volume-2e798874-d918-47cc-8e6a-fa30c6e6215d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663f95dd-2e5b-475d-9d93-f24f4bd06f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (663f95dd-2e5b-475d-9d93-f24f4bd06f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3376e738-2550-47b7-93e8-4697f002b1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Volume 2e798874-d918-47cc-8e6a-fa30c6e6215d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e798874-d918-47cc-8e6a-fa30c6e6215d', 'volume_size': 1}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1216379512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e798874-d918-47cc-8e6a-fa30c6e6215d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:22Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Creating volume 2e798874-d918-47cc-8e6a-fa30c6e6215d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:22 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:22 devstack sudo[99162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d 1073741824
Jul 07 03:45:22 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:23 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d 1073741824" returned: 0 in 0.969s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:23 devstack sudo[99168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d
Jul 07 03:45:23 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:24 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3376e738-2550-47b7-93e8-4697f002b1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e798874-d918-47cc-8e6a-fa30c6e6215d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14bf175-8f21-4faa-bd6b-93c9d33bf897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Volume volume-2e798874-d918-47cc-8e6a-fa30c6e6215d (2e798874-d918-47cc-8e6a-fa30c6e6215d): created successfully
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14bf175-8f21-4faa-bd6b-93c9d33bf897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (2c07b3ae-fedc-47d1-a47b-1446ab658e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4c5636f7-5148-4301-b567-b5e57f979401 tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-2e798874-d918-47cc-8e6a-fa30c6e6215d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "cinder-2e798874-d918-47cc-8e6a-fa30c6e6215d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-quobyte-2e798874-d918-47cc-8e6a-fa30c6e6215d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-2e798874-d918-47cc-8e6a-fa30c6e6215d" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[297aeb7f-fe95-4d4e-91f4-dc961dfe00b3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:24 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d
Jul 07 03:45:24 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:25 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d" returned: 0 in 0.894s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:25 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d
Jul 07 03:45:25 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:26 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2e798874-d918-47cc-8e6a-fa30c6e6215d" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-2e798874-d918-47cc-8e6a-fa30c6e6215d" released by "delete_volume" :: held 1.709s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Created reservations ['09fd0a80-e25b-4159-8e16-8377fc4a6b34', '02ae8e3a-7335-4644-90ad-2cb422286c39', 'c0bd27cf-1a9b-48e5-a02e-bba5ad657bd0', '05c7ae92-c984-4635-8608-eb7fa0a8e3f9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:26 devstack sudo[99179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:26 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:27 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.851s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Deleted volume successfully.
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-32360113-7b3e-461d-8fb0-75a3b7471d23 tempest-VolumesActionsTest-580120748 None] Lock "cinder-2e798874-d918-47cc-8e6a-fa30c6e6215d-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (cd8d73aa-a133-4f14-9dfa-13a0040eef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16271a72-dffb-4ece-8a85-e92e85d20050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16271a72-dffb-4ece-8a85-e92e85d20050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719405548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b23d0f-f174-46ec-a6d4-adf929ccf73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:28Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cd9851-f2ed-4ad6-936b-35fdadb3e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cd9851-f2ed-4ad6-936b-35fdadb3e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd9adc2-0c40-441e-808a-505efccf1d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd9adc2-0c40-441e-808a-505efccf1d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0b23d0f-f174-46ec-a6d4-adf929ccf73b', 'volume_name': 'volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d38e1-0001-48da-aac9-dcc9616bb051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15d38e1-0001-48da-aac9-dcc9616bb051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da48ed1d-92e8-4ce5-bf0b-85eda5f9d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Volume f0b23d0f-f174-46ec-a6d4-adf929ccf73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b', 'volume_size': 1}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-719405548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0b23d0f-f174-46ec-a6d4-adf929ccf73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:28Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Creating volume f0b23d0f-f174-46ec-a6d4-adf929ccf73b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:27 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:27 devstack sudo[99182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b 1073741824
Jul 07 03:45:27 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:28 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b 1073741824" returned: 0 in 1.015s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:28 devstack sudo[99188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b
Jul 07 03:45:28 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:29 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da48ed1d-92e8-4ce5-bf0b-85eda5f9d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62177666-c222-4b22-a85a-c2d05655decf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Volume volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b (f0b23d0f-f174-46ec-a6d4-adf929ccf73b): created successfully
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62177666-c222-4b22-a85a-c2d05655decf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (cd8d73aa-a133-4f14-9dfa-13a0040eef8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e24677a0-39e8-42f2-ac42-adf1d3740d5f tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-f0b23d0f-f174-46ec-a6d4-adf929ccf73b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "cinder-f0b23d0f-f174-46ec-a6d4-adf929ccf73b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-quobyte-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182c8f2-5406-4499-b5da-69c620254f02]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:30 devstack sudo[99192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b
Jul 07 03:45:30 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:30 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" returned: 0 in 0.845s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:30 devstack sudo[99197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b
Jul 07 03:45:30 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:31 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" returned: 0 in 0.704s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-f0b23d0f-f174-46ec-a6d4-adf929ccf73b" released by "delete_volume" :: held 1.623s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Created reservations ['e48cff84-4e49-41ae-b731-13190cd9a23f', '1b2507b4-7dcc-4576-ba07-7f8a60937121', 'd32d54a3-a652-4dd0-b2e1-1410e6656067', '6596e395-60a5-4214-97ae-8e019dce0ce5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:31 devstack sudo[99201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:31 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:32 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.933s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Deleted volume successfully.
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8f89f34f-3b04-4e82-a7da-748790df6856 tempest-VolumesActionsTest-580120748 None] Lock "cinder-f0b23d0f-f174-46ec-a6d4-adf929ccf73b-delete_volume" released by "delete_volume" :: held 2.824s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (2e720cbb-7f2a-4ce4-b457-5e0365d2049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381eeb04-6eeb-445c-8c69-27c8e46ced5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (381eeb04-6eeb-445c-8c69-27c8e46ced5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1118750734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41072c1b-261d-47a6-b073-dcae42e984d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:33Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4a72a8-76d8-47f2-8a69-5a0c09de3ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac4a72a8-76d8-47f2-8a69-5a0c09de3ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74582a7-d860-4632-a53e-4881dddf738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74582a7-d860-4632-a53e-4881dddf738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41072c1b-261d-47a6-b073-dcae42e984d6', 'volume_name': 'volume-41072c1b-261d-47a6-b073-dcae42e984d6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cf9bbb-e22d-41ad-a516-1975ac0d62de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cf9bbb-e22d-41ad-a516-1975ac0d62de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb586a90-1bb4-4047-8fc4-fc7e7318e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Volume 41072c1b-261d-47a6-b073-dcae42e984d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41072c1b-261d-47a6-b073-dcae42e984d6', 'volume_size': 1}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1118750734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41072c1b-261d-47a6-b073-dcae42e984d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:33Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Creating volume 41072c1b-261d-47a6-b073-dcae42e984d6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:33 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:33 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 1073741824
Jul 07 03:45:33 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:34 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 1073741824" returned: 0 in 1.023s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=74,cinder:UPDATE=90,cinder:DELETE=6,cinder:INSERT=26 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:34 devstack sudo[99210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6
Jul 07 03:45:34 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:34 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6" returned: 0 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.872s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb586a90-1bb4-4047-8fc4-fc7e7318e34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41072c1b-261d-47a6-b073-dcae42e984d6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacf375c-4b72-4ac3-a3cb-f87359870b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Volume volume-41072c1b-261d-47a6-b073-dcae42e984d6 (41072c1b-261d-47a6-b073-dcae42e984d6): created successfully
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacf375c-4b72-4ac3-a3cb-f87359870b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (2e720cbb-7f2a-4ce4-b457-5e0365d2049b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bd5bdb69-acde-408d-9dce-c3bfcc1010ad tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-41072c1b-261d-47a6-b073-dcae42e984d6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "cinder-41072c1b-261d-47a6-b073-dcae42e984d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-quobyte-41072c1b-261d-47a6-b073-dcae42e984d6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-41072c1b-261d-47a6-b073-dcae42e984d6" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc04b20-e2ed-4daa-ad4f-ef6fc4d2c7cd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:36 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6
Jul 07 03:45:36 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:37 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6" returned: 0 in 0.886s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:37 devstack sudo[99218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6
Jul 07 03:45:37 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:37 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-41072c1b-261d-47a6-b073-dcae42e984d6" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-41072c1b-261d-47a6-b073-dcae42e984d6" released by "delete_volume" :: held 1.746s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Created reservations ['2ae98e01-541a-44e6-8c65-d48c7476fe88', '2e78e5bf-60c3-4e33-a826-7aefa7feea1b', '0c9a4bdb-6cd0-4c30-890c-43160b7db1fc', '2592ee13-f80d-4ea4-a392-2ac7d7948497'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:38 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:38 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:39 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.055s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Deleted volume successfully.
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9ce86d0b-3f40-4ac4-95ff-20bb522fe152 tempest-VolumesActionsTest-580120748 None] Lock "cinder-41072c1b-261d-47a6-b073-dcae42e984d6-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (beb804b1-53a4-4da6-bdab-a7b20d20cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d7853-6e62-47e9-93b0-fc143a37f917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d7853-6e62-47e9-93b0-fc143a37f917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422970916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05501ebc-7031-46b9-be4f-689f8c9df7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:39Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d6ba6-403b-4568-8c58-61a5c22d82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893d6ba6-403b-4568-8c58-61a5c22d82b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d07116-a410-493b-936e-ae673ca5dd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d07116-a410-493b-936e-ae673ca5dd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05501ebc-7031-46b9-be4f-689f8c9df7f4', 'volume_name': 'volume-05501ebc-7031-46b9-be4f-689f8c9df7f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473f9256-248d-4c3e-b4ec-4daed181ec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473f9256-248d-4c3e-b4ec-4daed181ec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6738aed1-9850-4b6f-ae5a-65de9ffa8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Volume 05501ebc-7031-46b9-be4f-689f8c9df7f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05501ebc-7031-46b9-be4f-689f8c9df7f4', 'volume_size': 1}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422970916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05501ebc-7031-46b9-be4f-689f8c9df7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:39Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Creating volume 05501ebc-7031-46b9-be4f-689f8c9df7f4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:39 devstack sudo[99225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 1073741824
Jul 07 03:45:39 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:40 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 1073741824" returned: 0 in 1.002s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:40 devstack sudo[99231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4
Jul 07 03:45:40 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:41 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6738aed1-9850-4b6f-ae5a-65de9ffa8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05501ebc-7031-46b9-be4f-689f8c9df7f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e961b02d-a5fc-4034-a77f-a2314b39036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Volume volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 (05501ebc-7031-46b9-be4f-689f8c9df7f4): created successfully
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e961b02d-a5fc-4034-a77f-a2314b39036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (beb804b1-53a4-4da6-bdab-a7b20d20cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-43cbaa81-300e-4e0b-b63b-6ce3f6e8f1f9 tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (361fa1e3-13bb-4207-b957-d085c2d9d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0d2ef6-83e1-4cd9-bc39-5bb37cfb2f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af0d2ef6-83e1-4cd9-bc39-5bb37cfb2f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-683656877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0499db9d-4585-4790-a9b6-f0b7e222cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:42Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c455611f-6fc9-4922-9232-fcc91db83a17),volume_type_id=c455611f-6fc9-4922-9232-fcc91db83a17)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730f8ff0-7a49-42ad-beff-51bcb40797b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730f8ff0-7a49-42ad-beff-51bcb40797b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f79621b-87e1-4478-8987-f1269c9cb673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f79621b-87e1-4478-8987-f1269c9cb673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0499db9d-4585-4790-a9b6-f0b7e222cac9', 'volume_name': 'volume-0499db9d-4585-4790-a9b6-f0b7e222cac9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcf6d69-14ae-4cf0-bbc3-25a33340277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcf6d69-14ae-4cf0-bbc3-25a33340277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c01da95-de2a-4153-918f-2e076d3770b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume 0499db9d-4585-4790-a9b6-f0b7e222cac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0499db9d-4585-4790-a9b6-f0b7e222cac9', 'volume_size': 1}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-683656877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0499db9d-4585-4790-a9b6-f0b7e222cac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:42Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c455611f-6fc9-4922-9232-fcc91db83a17),volume_type_id=c455611f-6fc9-4922-9232-fcc91db83a17)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Creating volume 0499db9d-4585-4790-a9b6-f0b7e222cac9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:42 devstack sudo[99270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 1073741824
Jul 07 03:45:42 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (7c84a737-c4be-4ecf-96c8-6757ba452450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ed9c20-94d8-4f16-85cd-6255b95a7dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-05501ebc-7031-46b9-be4f-689f8c9df7f4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ed9c20-94d8-4f16-85cd-6255b95a7dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1857065273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02015b-f14d-41cf-baec-ddea813cfba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:43Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8b93d7b-bf5b-4347-abcd-c9b98eef27d2),volume_type_id=a8b93d7b-bf5b-4347-abcd-c9b98eef27d2)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9274aac9-1854-4c5d-9c2c-ff3411a18389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9274aac9-1854-4c5d-9c2c-ff3411a18389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ea2687-e51c-4469-b0dc-f62f3f885732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ea2687-e51c-4469-b0dc-f62f3f885732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a02015b-f14d-41cf-baec-ddea813cfba9', 'volume_name': 'volume-0a02015b-f14d-41cf-baec-ddea813cfba9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d447a7-3c08-45a8-84e6-135fd6f68a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d447a7-3c08-45a8-84e6-135fd6f68a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397b1df1-ee98-4fd9-8d5e-a8b3133cbbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Volume 0a02015b-f14d-41cf-baec-ddea813cfba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a02015b-f14d-41cf-baec-ddea813cfba9', 'volume_size': 1}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "cinder-05501ebc-7031-46b9-be4f-689f8c9df7f4-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Acquiring lock "cinder-quobyte-05501ebc-7031-46b9-be4f-689f8c9df7f4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-05501ebc-7031-46b9-be4f-689f8c9df7f4" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[115576f1-b4ce-4aeb-9a55-799c533fd619]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:43 devstack sudo[99272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4
Jul 07 03:45:43 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:43 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 1073741824" returned: 0 in 1.202s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:43 devstack sudo[99281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9
Jul 07 03:45:43 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (09a53e4b-4c42-4a07-89fa-668b75aaa396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e636b510-7646-4ea9-81da-fe79c9617113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e636b510-7646-4ea9-81da-fe79c9617113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-372065281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:44Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67d240f7-e535-4c8c-9dbf-df49cfefa08d),volume_type_id=67d240f7-e535-4c8c-9dbf-df49cfefa08d)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab20565-75cb-4b7f-bd5d-7c6cfda4c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab20565-75cb-4b7f-bd5d-7c6cfda4c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdafef69-20cb-454d-95b8-a1b5aa9628c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:43 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:45:44 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdafef69-20cb-454d-95b8-a1b5aa9628c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3', 'volume_name': 'volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3', 'volume_size': 1, 'image_id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1361479235', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57b28330ac134dcba99842c4a5266798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'created_at': datetime.datetime(2026, 7, 7, 1, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 45, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f31a300>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa261c7-98b5-4bb6-a131-51e102516a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fa261c7-98b5-4bb6-a131-51e102516a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd19705-ca92-490c-9866-8a277cea982b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3', 'volume_size': 1, 'image_id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1361479235', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57b28330ac134dcba99842c4a5266798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'created_at': datetime.datetime(2026, 7, 7, 1, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 45, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f31a300>}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Trying to clone 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 from image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4" returned: 0 in 1.318s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:44 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4
Jul 07 03:45:44 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:44 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9" returned: 0 in 0.869s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.649s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1857065273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a02015b-f14d-41cf-baec-ddea813cfba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:43Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8b93d7b-bf5b-4347-abcd-c9b98eef27d2),volume_type_id=a8b93d7b-bf5b-4347-abcd-c9b98eef27d2)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Creating volume 0a02015b-f14d-41cf-baec-ddea813cfba9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c01da95-de2a-4153-918f-2e076d3770b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0499db9d-4585-4790-a9b6-f0b7e222cac9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ba3191-9098-4373-a46c-a5b5ea57bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:44 devstack sudo[99289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 1073741824
Jul 07 03:45:44 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 (0499db9d-4585-4790-a9b6-f0b7e222cac9): created successfully
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ba3191-9098-4373-a46c-a5b5ea57bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (361fa1e3-13bb-4207-b957-d085c2d9d58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-19a92617-8c6e-4c04-b427-7c1583359139 tempest-TestInstancesWithCinderVolumes-648381723 None] Created volume successfully.
Jul 07 03:45:45 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-05501ebc-7031-46b9-be4f-689f8c9df7f4" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "cinder-quobyte-05501ebc-7031-46b9-be4f-689f8c9df7f4" released by "delete_volume" :: held 2.164s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Created reservations ['03509736-8e14-4de2-8761-9210e994d3aa', '44a4e4fe-1b87-43ea-9a79-d5fa0da92e35', 'ce0e0345-7186-4fe7-9ca5-129ad242c0c3', '43b91a8a-4225-4cb3-85ac-24d8262c6afd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:45 devstack sudo[99295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:45 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:45 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 1073741824" returned: 0 in 1.012s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:45 devstack sudo[99298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9
Jul 07 03:45:45 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:45 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.739s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Deleted volume successfully.
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-292a3258-7331-4e3d-9922-f1bea2ad8347 tempest-VolumesActionsTest-580120748 None] Lock "cinder-05501ebc-7031-46b9-be4f-689f8c9df7f4-delete_volume" released by "delete_volume" :: held 3.135s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:46 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397b1df1-ee98-4fd9-8d5e-a8b3133cbbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a02015b-f14d-41cf-baec-ddea813cfba9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508035ef-c7dc-4b86-96a8-e94a0761d4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Volume volume-0a02015b-f14d-41cf-baec-ddea813cfba9 (0a02015b-f14d-41cf-baec-ddea813cfba9): created successfully
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508035ef-c7dc-4b86-96a8-e94a0761d4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (7c84a737-c4be-4ecf-96c8-6757ba452450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dbb91621-322f-4896-807d-6c776c5b870a tempest-TestInstancesWithCinderVolumes-648381723 None] Created volume successfully.
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (5871c8e2-a805-4e96-beb5-b62431b5371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038510fc-63f4-42db-8165-c46dacfbc2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038510fc-63f4-42db-8165-c46dacfbc2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458125126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97b21f2-a4d7-43c0-af45-535f23b02e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:47Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498c1416-c4b8-4b59-a2be-a81c3c757607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498c1416-c4b8-4b59-a2be-a81c3c757607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7861e7a8-13a9-42c9-b73e-861aa43ea125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7861e7a8-13a9-42c9-b73e-861aa43ea125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97b21f2-a4d7-43c0-af45-535f23b02e2f', 'volume_name': 'volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfb196-5fd3-48f4-b67e-2ba3c1c0fb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17bfb196-5fd3-48f4-b67e-2ba3c1c0fb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaa464c-aea8-40b4-9a70-67f07863daa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Volume a97b21f2-a4d7-43c0-af45-535f23b02e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f', 'volume_size': 1}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458125126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97b21f2-a4d7-43c0-af45-535f23b02e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1fa9972fc44b0e850d1147d0d384b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:47Z,use_quota=True,user_id='2424229321ae42dba6295dde36831414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Creating volume a97b21f2-a4d7-43c0-af45-535f23b02e2f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:46 devstack sudo[99302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f 1073741824
Jul 07 03:45:46 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:47 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f 1073741824" returned: 0 in 0.895s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:47 devstack sudo[99307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f
Jul 07 03:45:47 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD, size 20.69 MB, duration 3.91 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:45:48 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Image download 20.69 MB at 5.29 MB/s
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922d2b2-bda7-417d-b131-882ea9ecbfd8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:48 devstack sudo[99309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD
Jul 07 03:45:48 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:48 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaa464c-aea8-40b4-9a70-67f07863daa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09204341-5120-42c0-8a2c-107dbc3a065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:45:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Volume volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f (a97b21f2-a4d7-43c0-af45-535f23b02e2f): created successfully
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09204341-5120-42c0-8a2c-107dbc3a065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:45:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Flow 'volume_create_manager' (5871c8e2-a805-4e96-beb5-b62431b5371e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:45:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-84b06bfb-8ab0-4985-8b1f-c3ae94d9f841 tempest-VolumesActionsTest-48038210 None] Created volume successfully.
Jul 07 03:45:49 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Temporary image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 is fetched for user 6cac5b5734bb40948f78e65b078e8196. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32fd65-07c7-43ef-9f2b-3b239dfd6531]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:49 devstack sudo[99317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD
Jul 07 03:45:49 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-a97b21f2-a4d7-43c0-af45-535f23b02e2f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "cinder-a97b21f2-a4d7-43c0-af45-535f23b02e2f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Acquiring lock "cinder-quobyte-a97b21f2-a4d7-43c0-af45-535f23b02e2f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "cinder-quobyte-a97b21f2-a4d7-43c0-af45-535f23b02e2f" acquired by "delete_volume" :: waited 0.060s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5914d3c-576c-41fe-97a0-da9fed235c1d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:50 devstack sudo[99319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f
Jul 07 03:45:50 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:50 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD" returned: 0 in 1.145s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-372065281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57b28330ac134dcba99842c4a5266798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:45:44Z,use_quota=True,user_id='6cac5b5734bb40948f78e65b078e8196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67d240f7-e535-4c8c-9dbf-df49cfefa08d),volume_type_id=67d240f7-e535-4c8c-9dbf-df49cfefa08d)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Creating volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:45:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:50 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1073741824
Jul 07 03:45:50 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:50 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f" returned: 0 in 1.014s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:50 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f
Jul 07 03:45:50 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:51 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1073741824" returned: 0 in 1.019s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:51 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:45:51 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:51 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a97b21f2-a4d7-43c0-af45-535f23b02e2f" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "cinder-quobyte-a97b21f2-a4d7-43c0-af45-535f23b02e2f" released by "delete_volume" :: held 1.900s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Created reservations ['003e48fa-3ce4-4d43-a5f9-502fd9d363eb', '0eeaa06d-65e5-4eec-a051-51722e52930c', 'abfce2b8-eccc-4bcd-8119-7f65be08339c', 'b4621121-01bb-457a-ba4b-3601d31e6a47'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:51 devstack sudo[99366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:45:51 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:52 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 0.736s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Attempting download of 72515c78-6d69-4c14-8c7d-ce46a8e458e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}])) to volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[63266fb6-c54c-4676-a8bc-0d891cb1fae9]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:52 devstack sudo[99374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n
Jul 07 03:45:52 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:52 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.711s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:45:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Deleted volume successfully.
Jul 07 03:45:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9aed99e5-b74d-4f38-9fed-dcf874a41344 tempest-VolumesActionsTest-48038210 None] Lock "cinder-a97b21f2-a4d7-43c0-af45-535f23b02e2f-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:45:53 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:53 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n
Jul 07 03:45:53 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:53 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n" returned: 1 in 0.790s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72515c78-6d69-4c14-8c7d-ce46a8e458e6_cto4gx3n' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfdaf7c-0318-4319-8ff7-7be1b3a8585d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:54 devstack sudo[99393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD
Jul 07 03:45:54 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:54 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:54 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] 72515c78-6d69-4c14-8c7d-ce46a8e458e6 was qcow2, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:45:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:55 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:45:55 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:57 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 2.603s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:57 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72515c78-6d69-4c14-8c7d-ce46a8e458e6_q1emp7xsdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:45:57 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Converted 112.00 MB image at 43.00 MB/s
Jul 07 03:45:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:57 devstack sudo[99481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1G
Jul 07 03:45:57 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:58 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 1G" returned: 0 in 0.978s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c750c20-da4f-4d27-af40-1f5ec9a0c8ca]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:45:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:58 devstack sudo[99487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:45:58 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:45:59 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root
Jul 07 03:45:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 1.020s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:45:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:45:59 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:45:59 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:00 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 1 in 1.001s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Downloaded image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}])) to volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Temporary image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 for user 6cac5b5734bb40948f78e65b078e8196 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Marking volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Copying metadata from image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 to 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Creating volume glance metadata for volume 7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 backed by image 72515c78-6d69-4c14-8c7d-ce46a8e458e6 with: {'image_id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'image_name': 'tempest-scenario-img--1361479235', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd19705-ca92-490c-9866-8a277cea982b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3', 'volume_size': 1, 'image_id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1361479235', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '57b28330ac134dcba99842c4a5266798', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72515c78-6d69-4c14-8c7d-ce46a8e458e6', 'created_at': datetime.datetime(2026, 7, 7, 1, 45, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 45, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72515c78-6d69-4c14-8c7d-ce46a8e458e6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f31a300>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9035e4b4-ddff-4282-b404-2f1aac2fd440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Volume volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 (7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3): created successfully
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9035e4b4-ddff-4282-b404-2f1aac2fd440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Flow 'volume_create_manager' (09a53e4b-4c42-4a07-89fa-668b75aaa396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-52b43949-7c97-4331-8d5d-b6f3ff960aa0 tempest-TestInstancesWithCinderVolumes-648381723 None] Created volume successfully.
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Flow 'volume_create_manager' (97be066d-a5cb-423f-a7ff-19a09667f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2472b5a3-3f2d-4258-92cf-610838a5fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2472b5a3-3f2d-4258-92cf-610838a5fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1724559183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422f7523ffc44d8393f8c57380463b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:01Z,use_quota=True,user_id='6aa043190fac4dc08c20e4804931e373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f75c880-aa60-4e6f-bc17-0feeea588b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f75c880-aa60-4e6f-bc17-0feeea588b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88b6dd-3d12-435c-8b16-27dd398b2c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88b6dd-3d12-435c-8b16-27dd398b2c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3', 'volume_name': 'volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed59f53b-1b09-42d6-96ff-9acfe6a131b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed59f53b-1b09-42d6-96ff-9acfe6a131b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4114d639-f15c-4ab0-b785-b3f578fdef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Volume 3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3', 'volume_size': 1}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1724559183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422f7523ffc44d8393f8c57380463b01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:01Z,use_quota=True,user_id='6aa043190fac4dc08c20e4804931e373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Creating volume 3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:46:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:46:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:01 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 1073741824
Jul 07 03:46:01 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:02 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 1073741824" returned: 0 in 1.146s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:02 devstack sudo[99504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3
Jul 07 03:46:02 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:03 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" returned: 0 in 1.021s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4114d639-f15c-4ab0-b785-b3f578fdef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ebf65-2776-483e-b3e1-9f045f185e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Volume volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 (3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3): created successfully
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ebf65-2776-483e-b3e1-9f045f185e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Flow 'volume_create_manager' (97be066d-a5cb-423f-a7ff-19a09667f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-79f347fc-dbbe-46b6-b016-0b071cd98b86 tempest-TestMinimumBasicScenario-1648820016 None] Created volume successfully.
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Flow 'volume_create_manager' (1727513d-689e-4ee1-bc55-0f7c870e10c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2942ea2-ab84-4666-9434-e2db943a5934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2942ea2-ab84-4666-9434-e2db943a5934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961937777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022dc624-b5e1-47ba-8c80-49228f673cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8d8b026d4147b7bb1c4b8d92fb8bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:08Z,use_quota=True,user_id='de4e4589fd7d46a4b4a039839b20413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a8974-6418-45ae-8ecd-8cc53b44bdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429a8974-6418-45ae-8ecd-8cc53b44bdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d666b014-4b46-4e39-8625-1112e86deaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d666b014-4b46-4e39-8625-1112e86deaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022dc624-b5e1-47ba-8c80-49228f673cc2', 'volume_name': 'volume-022dc624-b5e1-47ba-8c80-49228f673cc2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f69ecf6-fc8c-4ce4-a424-dd60bb49cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f69ecf6-fc8c-4ce4-a424-dd60bb49cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bb96f2-1f76-4c0a-ac99-c3f65e3ced0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Volume 022dc624-b5e1-47ba-8c80-49228f673cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022dc624-b5e1-47ba-8c80-49228f673cc2', 'volume_size': 1}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961937777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022dc624-b5e1-47ba-8c80-49228f673cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd8d8b026d4147b7bb1c4b8d92fb8bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:08Z,use_quota=True,user_id='de4e4589fd7d46a4b4a039839b20413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Creating volume 022dc624-b5e1-47ba-8c80-49228f673cc2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:46:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:07 devstack sudo[99521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 1073741824
Jul 07 03:46:07 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:08 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 1073741824" returned: 0 in 1.029s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:08 devstack sudo[99529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2
Jul 07 03:46:08 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:09 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2" returned: 0 in 0.896s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.801s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67bb96f2-1f76-4c0a-ac99-c3f65e3ced0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022dc624-b5e1-47ba-8c80-49228f673cc2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99afaaae-0dbf-44a3-9693-bcbcb1ba851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7aacfc-b997-47c2-92e5-7203a3833722]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Volume volume-022dc624-b5e1-47ba-8c80-49228f673cc2 (022dc624-b5e1-47ba-8c80-49228f673cc2): created successfully
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99afaaae-0dbf-44a3-9693-bcbcb1ba851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Flow 'volume_create_manager' (1727513d-689e-4ee1-bc55-0f7c870e10c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3bef193f-6978-49b2-9c7c-6c257c6ad120 tempest-AbsoluteLimitsTests-579652478 None] Created volume successfully.
Jul 07 03:46:09 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3
Jul 07 03:46:09 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:10 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" returned: 0 in 0.871s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.485s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ada88d4-a4ed-46ca-b5f6-c69ee84e49c7', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f007e-b880-43d4-8968-1f995664e507]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:46:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-4e85ca7e-e31e-44af-8f25-2e6c427dd4c0 req-b02f4bf6-133d-4224-a00b-4a247df2c0cb tempest-TestMinimumBasicScenario-1648820016 None] attachment_update completed successfully.
Jul 07 03:46:10 devstack sudo[99564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:46:10 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Acquiring lock "cinder-022dc624-b5e1-47ba-8c80-49228f673cc2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "cinder-022dc624-b5e1-47ba-8c80-49228f673cc2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Acquiring lock "cinder-quobyte-022dc624-b5e1-47ba-8c80-49228f673cc2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "cinder-quobyte-022dc624-b5e1-47ba-8c80-49228f673cc2" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0f14f6-ff52-4c36-8fc9-d259cc1e41d5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:11 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 0.887s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:11 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2
Jul 07 03:46:11 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:11 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:46:11 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:12 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2" returned: 0 in 0.827s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:12 devstack sudo[99961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2
Jul 07 03:46:12 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:12 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 1 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.728s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f81c7c69-b391-4ce5-ab35-6a23634c9415', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:46:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-abdafd35-9ad5-404b-a447-d84c11cbbaea req-81395ea7-098e-4a91-a6a4-f2b8dbeecce7 tempest-TestInstancesWithCinderVolumes-648381723 None] attachment_update completed successfully.
Jul 07 03:46:13 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-022dc624-b5e1-47ba-8c80-49228f673cc2" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "cinder-quobyte-022dc624-b5e1-47ba-8c80-49228f673cc2" released by "delete_volume" :: held 1.580s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Created reservations ['1886bab2-fda5-473a-ab22-9fe988feb61c', '71dbf2b3-fa8f-484d-a614-a4d639de942e', 'c1f63506-0e73-4d30-a29b-9eb8e644ea74', '226d8586-1a9b-427a-8455-d4364384830e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:13 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:46:13 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:13 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.717s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:46:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Deleted volume successfully.
Jul 07 03:46:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3379f288-4846-4efe-9357-74187ab23d7e tempest-AbsoluteLimitsTests-579652478 None] Lock "cinder-022dc624-b5e1-47ba-8c80-49228f673cc2-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:15 devstack sudo[99967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:46:15 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:16 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.087s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:46:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:46:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:46:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:46:23 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=56,cinder:SELECT=49,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:46:23 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=69,cinder:UPDATE=90,cinder:INSERT=17,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Flow 'volume_create_manager' (0352f7db-e912-4156-9764-7bdd57edfbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327a32e5-3103-4642-806b-1a1d1c1f67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327a32e5-3103-4642-806b-1a1d1c1f67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398781447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62bb84d-21fc-410c-8174-76d85e9510c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25135983c6604e03a3f2c609ce5580cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:30Z,use_quota=True,user_id='07d324b775ab47ec9fe83cfe83f6ed50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7310421-4936-4c88-8250-8150a8763b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7310421-4936-4c88-8250-8150a8763b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ad580e-0a54-490d-a975-236346d67641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ad580e-0a54-490d-a975-236346d67641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62bb84d-21fc-410c-8174-76d85e9510c6', 'volume_name': 'volume-f62bb84d-21fc-410c-8174-76d85e9510c6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e1f929-20c7-4968-acc6-65cdf1a39df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e1f929-20c7-4968-acc6-65cdf1a39df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a75d241-14ea-4cdd-8567-3fa78de1f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Volume f62bb84d-21fc-410c-8174-76d85e9510c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62bb84d-21fc-410c-8174-76d85e9510c6', 'volume_size': 1}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1398781447',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62bb84d-21fc-410c-8174-76d85e9510c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25135983c6604e03a3f2c609ce5580cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:46:30Z,use_quota=True,user_id='07d324b775ab47ec9fe83cfe83f6ed50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Creating volume f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:46:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:46:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:30 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 1073741824
Jul 07 03:46:30 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:31 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 1073741824" returned: 0 in 1.283s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:31 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:46:31 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:32 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a75d241-14ea-4cdd-8567-3fa78de1f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62bb84d-21fc-410c-8174-76d85e9510c6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca471ce1-60d7-4aa7-a753-86a2686e23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:46:32 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Volume volume-f62bb84d-21fc-410c-8174-76d85e9510c6 (f62bb84d-21fc-410c-8174-76d85e9510c6): created successfully
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca471ce1-60d7-4aa7-a753-86a2686e23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:46:32 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Flow 'volume_create_manager' (0352f7db-e912-4156-9764-7bdd57edfbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:46:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-28a0558b-f276-4ec6-8e4f-98f0888929b5 tempest-VolumesActionsTest-399469098 None] Created volume successfully.
Jul 07 03:46:42 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:46:42 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfa00bb-a70d-4700-a618-7e292110dc4c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:49 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9
Jul 07 03:46:49 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-be1afabf-f22f-49ee-a530-e3e51be0c9e6 tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-be1afabf-f22f-49ee-a530-e3e51be0c9e6 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" acquired by "attach_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:46:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-be1afabf-f22f-49ee-a530-e3e51be0c9e6 tempest-VolumesActionsTest-399469098 None] Attaching volume f62bb84d-21fc-410c-8174-76d85e9510c6 to instance 87455963-c04b-45a6-9276-1d9738230fd2 at mountpoint /dev/vdb on host None.
Jul 07 03:46:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-be1afabf-f22f-49ee-a530-e3e51be0c9e6 tempest-VolumesActionsTest-399469098 None] Attach volume completed successfully.
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-be1afabf-f22f-49ee-a530-e3e51be0c9e6 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" released by "attach_volume" :: held 0.114s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:46:49 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9" returned: 0 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.890s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-0499db9d-4585-4790-a9b6-f0b7e222cac9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2b95fda-c22b-481e-869a-e4a184a98828', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:46:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-716fcaff-0af7-4b6b-a70c-1d66ab8ada98 req-ba07e54d-df6b-420f-931d-b54f4a28e656 tempest-TestInstancesWithCinderVolumes-648381723 None] attachment_update completed successfully.
Jul 07 03:46:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aa04105c-0f46-476d-af00-4a706c755fc0 tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:46:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aa04105c-0f46-476d-af00-4a706c755fc0 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:46:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aa04105c-0f46-476d-af00-4a706c755fc0 tempest-VolumesActionsTest-399469098 None] Detaching volume f62bb84d-21fc-410c-8174-76d85e9510c6 from instance 87455963-c04b-45a6-9276-1d9738230fd2.
Jul 07 03:46:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aa04105c-0f46-476d-af00-4a706c755fc0 tempest-VolumesActionsTest-399469098 None] Detach volume completed successfully.
Jul 07 03:46:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-aa04105c-0f46-476d-af00-4a706c755fc0 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:46:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:46:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:46:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7827d6d-6f0b-42df-afe9-38c3f28b4537]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:46:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:46:58 devstack sudo[100395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9
Jul 07 03:46:58 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:46:58 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root
Jul 07 03:46:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9" returned: 0 in 0.902s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:46:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.933s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:46:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-0a02015b-f14d-41cf-baec-ddea813cfba9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd785bc67-cd90-49e8-b26e-65a23acf93c5', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:46:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-f297c1bb-e914-42ba-b91b-39b2286f38dd req-a6df5641-3ac8-4f92-8eb3-cdae62a4a68d tempest-TestInstancesWithCinderVolumes-648381723 None] attachment_update completed successfully.
Jul 07 03:47:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-5f182817-7bd3-4b0a-95f1-f2a8da4bbb1c req-40d215e9-cca6-4185-98b9-b019d9a95218 tempest-TestInstancesWithCinderVolumes-648381723 None] Terminate volume connection completed successfully.
Jul 07 03:47:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-5f182817-7bd3-4b0a-95f1-f2a8da4bbb1c req-40d215e9-cca6-4185-98b9-b019d9a95218 tempest-TestInstancesWithCinderVolumes-648381723 None] Deleting attachment c2b95fda-c22b-481e-869a-e4a184a98828. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-0499db9d-4585-4790-a9b6-f0b7e222cac9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-0499db9d-4585-4790-a9b6-f0b7e222cac9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-quobyte-0499db9d-4585-4790-a9b6-f0b7e222cac9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-0499db9d-4585-4790-a9b6-f0b7e222cac9" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6a5ac5-2cb9-48e5-ae52-fb5673f293ad]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:10 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9
Jul 07 03:47:10 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:11 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9" returned: 0 in 1.332s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-68821cdc-3aeb-4b9f-85b9-163b4b5a8c3f req-e21ad246-91f6-440d-acc2-6712ccc36a81 tempest-TestMinimumBasicScenario-1648820016 None] Terminate volume connection completed successfully.
Jul 07 03:47:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-68821cdc-3aeb-4b9f-85b9-163b4b5a8c3f req-e21ad246-91f6-440d-acc2-6712ccc36a81 tempest-TestMinimumBasicScenario-1648820016 None] Deleting attachment 5ada88d4-a4ed-46ca-b5f6-c69ee84e49c7. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:47:11 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9
Jul 07 03:47:11 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:12 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0499db9d-4585-4790-a9b6-f0b7e222cac9" returned: 0 in 0.813s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-0499db9d-4585-4790-a9b6-f0b7e222cac9" released by "delete_volume" :: held 2.197s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:12 devstack cinder-volume[86955]: WARNING cinder.quota [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1625939195-264759112 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1625939195-264759112, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:12 devstack cinder-volume[86955]: WARNING cinder.quota [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1625939195-264759112 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1625939195-264759112, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Created reservations ['d586c5b7-cbf0-4dd5-8985-2a05b644043b', '3c90a211-2ef8-4e6a-8588-859abb5aa65c', 'b2e85d7d-b1f8-4e9c-abcc-0b1d741d5d18', '161ffa8e-8051-44e3-9cb6-ac285e37b3c5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:12 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:47:12 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:13 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.810s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:47:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Deleted volume successfully.
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-054fe3a3-1881-4343-83ba-53f3a1948840 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-0499db9d-4585-4790-a9b6-f0b7e222cac9-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "cinder-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "cinder-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "cinder-quobyte-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "cinder-quobyte-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ae9f60-a393-4f61-a0da-19eb3f4ddfc0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:13 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3
Jul 07 03:47:13 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:14 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:14 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3
Jul 07 03:47:14 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:15 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" returned: 0 in 0.697s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "cinder-quobyte-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3" released by "delete_volume" :: held 1.641s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Created reservations ['ee97fac1-f961-4b75-8e0f-debfb4426a08', 'aae29d7a-ecab-4b1e-a320-35dc15d2a2ab', '1f3db582-3883-402b-b786-80809630270c', 'b7869304-533a-49c6-b450-77028a4f1869'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:15 devstack sudo[100585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:47:15 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:15 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:47:15 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b613bf38-c10f-4a49-bc25-e8c4815a737c tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" by "attach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b613bf38-c10f-4a49-bc25-e8c4815a737c tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" acquired by "attach_volume" :: waited 0.060s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-bd4c407f-b867-419d-8a5a-276a72759d6e req-91c6d8a6-496a-4db2-bcea-e888eba16af3 tempest-TestInstancesWithCinderVolumes-648381723 None] Terminate volume connection completed successfully.
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-bd4c407f-b867-419d-8a5a-276a72759d6e req-91c6d8a6-496a-4db2-bcea-e888eba16af3 tempest-TestInstancesWithCinderVolumes-648381723 None] Deleting attachment d785bc67-cd90-49e8-b26e-65a23acf93c5. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:47:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b613bf38-c10f-4a49-bc25-e8c4815a737c tempest-VolumesActionsTest-399469098 None] Attaching volume f62bb84d-21fc-410c-8174-76d85e9510c6 to instance f475d94b-c328-4c4b-b11d-7ff17de45a58 at mountpoint /dev/vdb on host None.
Jul 07 03:47:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b613bf38-c10f-4a49-bc25-e8c4815a737c tempest-VolumesActionsTest-399469098 None] Attach volume completed successfully.
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b613bf38-c10f-4a49-bc25-e8c4815a737c tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6" released by "attach_volume" :: held 0.221s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:16 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.000s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:47:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Deleted volume successfully.
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-11fc8b20-b1b1-429f-8854-c76a63aa08db tempest-TestMinimumBasicScenario-1648820016 None] Lock "cinder-3cce17ce-20cf-4b9b-900e-7fb2c85e0fe3-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:16 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.087s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50c47c4b-a927-4e97-9d1a-dd1bb7e2c0c7 tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" by "detach_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50c47c4b-a927-4e97-9d1a-dd1bb7e2c0c7 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-50c47c4b-a927-4e97-9d1a-dd1bb7e2c0c7 tempest-VolumesActionsTest-399469098 None] Detaching volume f62bb84d-21fc-410c-8174-76d85e9510c6 from instance f475d94b-c328-4c4b-b11d-7ff17de45a58.
Jul 07 03:47:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-50c47c4b-a927-4e97-9d1a-dd1bb7e2c0c7 tempest-VolumesActionsTest-399469098 None] Detach volume completed successfully.
Jul 07 03:47:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-50c47c4b-a927-4e97-9d1a-dd1bb7e2c0c7 tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-detach_volume" released by "detach_volume" :: held 0.059s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-0a02015b-f14d-41cf-baec-ddea813cfba9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-0a02015b-f14d-41cf-baec-ddea813cfba9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-quobyte-0a02015b-f14d-41cf-baec-ddea813cfba9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-0a02015b-f14d-41cf-baec-ddea813cfba9" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc0faf5-9c4c-460a-9db5-1887a5d16370]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:17 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9
Jul 07 03:47:17 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:18 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9" returned: 0 in 1.117s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:18 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9
Jul 07 03:47:18 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:19 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a02015b-f14d-41cf-baec-ddea813cfba9" returned: 0 in 0.882s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-0a02015b-f14d-41cf-baec-ddea813cfba9" released by "delete_volume" :: held 2.094s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:19 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471717502-1787366478 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471717502-1787366478, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:19 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471717502-1787366478 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1471717502-1787366478, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Created reservations ['c09d8002-7087-40ba-80af-fa5afbc6135f', '308bf260-5ae4-4393-a62b-354c3b954d0d', '746e3d7e-d91b-4f51-9821-ce6518812061', '12d52638-99a6-49d2-9c1d-24bb1e0661f5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:19 devstack sudo[100647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:47:19 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:20 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.002s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:47:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Deleted volume successfully.
Jul 07 03:47:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4f81cca-f0ed-49f5-8f8b-bf0c91647d77 tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-0a02015b-f14d-41cf-baec-ddea813cfba9-delete_volume" released by "delete_volume" :: held 3.442s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-cf9f4835-1eb7-4074-821b-58ec81e59ab4 req-4981a600-29f5-472b-9387-4f6478d7a937 tempest-TestInstancesWithCinderVolumes-648381723 None] Terminate volume connection completed successfully.
Jul 07 03:47:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-cf9f4835-1eb7-4074-821b-58ec81e59ab4 req-4981a600-29f5-472b-9387-4f6478d7a937 tempest-TestInstancesWithCinderVolumes-648381723 None] Deleting attachment f81c7c69-b391-4ce5-ab35-6a23634c9415. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:47:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[580bce81-aa4f-48c9-b10a-a2c8f8f87f72]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:26 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:47:26 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:27 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.827s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ae1f0-ff02-4756-9398-eda3b42fb13f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:27 devstack sudo[100687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:47:27 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:27 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.09a03417-3cca-438e-9f47-086588bf2509nnphe89j.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:27 devstack sudo[100692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.09a03417-3cca-438e-9f47-086588bf2509nnphe89j.img
Jul 07 03:47:27 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "cinder-quobyte-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:47:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" acquired by "delete_volume" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:47:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf96c019-66c4-47d4-bd1d-5d20e64ef0a3]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:29 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:47:29 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:30 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 1.505s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:30 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:47:30 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:32 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 1 in 1.735s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:47:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:32 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3
Jul 07 03:47:32 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:33 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.09a03417-3cca-438e-9f47-086588bf2509nnphe89j.img" returned: 0 in 5.673s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db6c74a-ff09-45ce-a113-310488937431]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:33 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" returned: 0 in 1.284s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-quobyte-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3" released by "delete_volume" :: held 4.655s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:33 devstack sudo[100720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:47:33 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:33 devstack cinder-volume[86955]: WARNING cinder.quota [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2011453891-1448650389 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2011453891-1448650389, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:33 devstack cinder-volume[86955]: WARNING cinder.quota [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2011453891-1448650389 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2011453891-1448650389, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Created reservations ['94c64160-dbda-4ed1-a140-82b674cce065', '51f2e687-e1b8-4d1c-9dfb-c9ca82b55652', '29d13500-e874-4d30-b794-06c529b40a62', '911f1ad6-0aa0-4bb2-a3b2-793866b7ed98'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:33 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:47:33 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:34 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.687s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:47:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Deleted volume successfully.
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-edbb09cc-0fbe-46c9-9cc9-c6b84f90f34b tempest-TestInstancesWithCinderVolumes-648381723 None] Lock "cinder-7c87b6c6-7fe9-436d-96f9-a64a4e21c4d3-delete_volume" released by "delete_volume" :: held 5.692s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:47:34 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 1.031s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.09a03417-3cca-438e-9f47-086588bf2509nnphe89j.img {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:47:34 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Converted 1024.00 MB image at 180.42 MB/s
Jul 07 03:47:34 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] 09a03417-3cca-438e-9f47-086588bf2509 was raw, no need to convert to raw {{(pid=86955) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (4b48cfde-e945-4927-88ae-c5beb86cbc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51672cf-8907-4fa9-9c3d-968b3b70ef49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e51672cf-8907-4fa9-9c3d-968b3b70ef49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747852212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6504d-37a6-406a-94e8-a5b6a57bbbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:37Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8d857e-8c6b-4a13-a7be-0d5ddb8fe89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8d857e-8c6b-4a13-a7be-0d5ddb8fe89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb52fd-9deb-4082-a92e-983b732aa08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4bb52fd-9deb-4082-a92e-983b732aa08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afd6504d-37a6-406a-94e8-a5b6a57bbbe2', 'volume_name': 'volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cbfcbb-6648-4f2e-82fc-b2ddaa6fea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87cbfcbb-6648-4f2e-82fc-b2ddaa6fea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f43165d-28d6-401f-a0ab-77e0e27fa7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Volume afd6504d-37a6-406a-94e8-a5b6a57bbbe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2', 'volume_size': 1}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (14c8e4d2-1709-4dfd-93d9-90a23590ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9c3f4a-7d4e-42c3-a707-34deb45e20ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9c3f4a-7d4e-42c3-a707-34deb45e20ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100198907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2a9f85-aa48-41f9-8ef1-c21e47f9425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:37Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81805788-5713-4bd1-8cb7-1c2c5a3991d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81805788-5713-4bd1-8cb7-1c2c5a3991d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d1442e-d06c-4f17-8cd4-0104a5aed202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d1442e-d06c-4f17-8cd4-0104a5aed202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2a9f85-aa48-41f9-8ef1-c21e47f9425c', 'volume_name': 'volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439ca1ab-fc57-4f73-a088-c520ec035e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439ca1ab-fc57-4f73-a088-c520ec035e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5744cd-81f7-4caa-a682-0fce40e00c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:37 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Volume 2b2a9f85-aa48-41f9-8ef1-c21e47f9425c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c', 'volume_size': 1}
Jul 07 03:47:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (263b6aba-af73-492a-b034-d7a23f8228a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c78441-2d30-40a2-b7bb-15f0bca32af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c78441-2d30-40a2-b7bb-15f0bca32af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1034052895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bb8094-1d39-4ff3-860d-d8aa6ad71777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:38Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a734976-b960-4cb2-a76d-0b6ccc4c98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a734976-b960-4cb2-a76d-0b6ccc4c98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18243c3e-81e0-4911-8950-505eab2f694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18243c3e-81e0-4911-8950-505eab2f694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bb8094-1d39-4ff3-860d-d8aa6ad71777', 'volume_name': 'volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09baf8fc-cc60-4fa9-940a-85e060409dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09baf8fc-cc60-4fa9-940a-85e060409dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa957422-9eb9-46db-8fe6-58c859e651b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Volume 37bb8094-1d39-4ff3-860d-d8aa6ad71777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777', 'volume_size': 1}
Jul 07 03:47:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (3431c1c8-ceb5-4d2f-846b-0c736ae20879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9681b778-c1a7-422d-b1d6-819fb7084224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9681b778-c1a7-422d-b1d6-819fb7084224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21705392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5b32eb-f7db-4a08-a791-2e8480f016d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:39Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af81ef15-9ccc-40ef-95e8-aecea7b29b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af81ef15-9ccc-40ef-95e8-aecea7b29b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60256fd-3a27-4fc8-b334-5fa034918bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60256fd-3a27-4fc8-b334-5fa034918bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5b32eb-f7db-4a08-a791-2e8480f016d3', 'volume_name': 'volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefb1017-fe40-4d8e-b40b-3c879bc5c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aefb1017-fe40-4d8e-b40b-3c879bc5c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07ba12-f4ae-4cab-8bd8-ad322c5043ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Volume 7e5b32eb-f7db-4a08-a791-2e8480f016d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3', 'volume_size': 1}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (1e2f7a10-1be0-4af9-8c7e-50ffc132d41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af016e7-dcbe-4085-bd6a-4d6268814e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af016e7-dcbe-4085-bd6a-4d6268814e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018490564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d899ea5-7e4b-44c5-89fb-1cb3da7658b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:39Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ef74b2-da20-472c-a224-5966571fc2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ef74b2-da20-472c-a224-5966571fc2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fca247-5665-49f8-8b26-1db742eb4a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fca247-5665-49f8-8b26-1db742eb4a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d899ea5-7e4b-44c5-89fb-1cb3da7658b6', 'volume_name': 'volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208bd921-2fb8-4682-af1e-6880a2e8db0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208bd921-2fb8-4682-af1e-6880a2e8db0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0f6c11-2f9e-4904-9702-ef47f2ae579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Volume 0d899ea5-7e4b-44c5-89fb-1cb3da7658b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6', 'volume_size': 1}
Jul 07 03:47:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=54,cinder:INSERT=11,cinder:UPDATE=42,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:47:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=56,cinder:INSERT=9,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.065s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Uploaded volume to glance image-id: 09a03417-3cca-438e-9f47-086588bf2509. {{(pid=86955) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.036s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747852212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd6504d-37a6-406a-94e8-a5b6a57bbbe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:37Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Creating volume afd6504d-37a6-406a-94e8-a5b6a57bbbe2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:47:57 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:47:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:57 devstack sudo[100777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 1073741824
Jul 07 03:47:57 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-94fac8d1-62bc-42d1-a57d-5523ab1ec660 tempest-VolumesActionsTest-399469098 None] Copy volume to image completed successfully.
Jul 07 03:47:58 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 1073741824" returned: 0 in 1.034s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:58 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2
Jul 07 03:47:58 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:59 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" returned: 0 in 0.694s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.385s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1100198907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2a9f85-aa48-41f9-8ef1-c21e47f9425c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:37Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Creating volume 2b2a9f85-aa48-41f9-8ef1-c21e47f9425c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:47:59 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f43165d-28d6-401f-a0ab-77e0e27fa7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:59 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c 1073741824
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a42fd5-0ab0-4eb1-b53a-62dc0e48b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:47:59 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:47:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Volume volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 (afd6504d-37a6-406a-94e8-a5b6a57bbbe2): created successfully
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a42fd5-0ab0-4eb1-b53a-62dc0e48b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (4b48cfde-e945-4927-88ae-c5beb86cbc22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:47:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7ca4806b-91f2-4f1b-9029-c230de1a1ed0 tempest-CreateVolumesFromImageTest-401066564 None] Created volume successfully.
Jul 07 03:47:59 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Jul 07 03:47:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c 1073741824" returned: 0 in 0.876s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:00 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c
Jul 07 03:48:00 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:00 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.486s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1034052895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bb8094-1d39-4ff3-860d-d8aa6ad71777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:38Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Creating volume 37bb8094-1d39-4ff3-860d-d8aa6ad71777 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:00 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 1073741824
Jul 07 03:48:00 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5744cd-81f7-4caa-a682-0fce40e00c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149ed843-324c-461a-8428-0e6dc4e47e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Volume volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c (2b2a9f85-aa48-41f9-8ef1-c21e47f9425c): created successfully
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149ed843-324c-461a-8428-0e6dc4e47e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (14c8e4d2-1709-4dfd-93d9-90a23590ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ddd81d61-49b8-4275-850d-323e109adc64 tempest-CreateVolumesFromImageTest-401066564 None] Created volume successfully.
Jul 07 03:48:01 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 1073741824" returned: 0 in 0.943s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:01 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777
Jul 07 03:48:01 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:02 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.242s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-21705392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5b32eb-f7db-4a08-a791-2e8480f016d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:39Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Creating volume 7e5b32eb-f7db-4a08-a791-2e8480f016d3 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:02 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa957422-9eb9-46db-8fe6-58c859e651b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:02 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 1073741824
Jul 07 03:48:02 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb4d739-d0c2-4fa8-98bc-c1b24158e9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Volume volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 (37bb8094-1d39-4ff3-860d-d8aa6ad71777): created successfully
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb4d739-d0c2-4fa8-98bc-c1b24158e9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (263b6aba-af73-492a-b034-d7a23f8228a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e0bb8055-c03c-4f84-b625-129920f7812a tempest-CreateVolumesFromImageTest-401066564 None] Created volume successfully.
Jul 07 03:48:03 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 1073741824" returned: 0 in 0.894s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:03 devstack sudo[100813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3
Jul 07 03:48:03 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:03 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.679s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018490564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d899ea5-7e4b-44c5-89fb-1cb3da7658b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c612364ea7d34774b4f4b49cc2e651d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:47:39Z,use_quota=True,user_id='1b946b693b6f4173b7f460d7a1c624df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Creating volume 0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:04 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:04 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 1073741824
Jul 07 03:48:04 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f07ba12-f4ae-4cab-8bd8-ad322c5043ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d98d1-c251-4697-9262-d774bd645267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Volume volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 (7e5b32eb-f7db-4a08-a791-2e8480f016d3): created successfully
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53d98d1-c251-4697-9262-d774bd645267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (3431c1c8-ceb5-4d2f-846b-0c736ae20879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-95047746-9a14-4d72-96a4-159280e6760d tempest-CreateVolumesFromImageTest-401066564 None] Created volume successfully.
Jul 07 03:48:05 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 1073741824" returned: 0 in 1.020s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:05 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6
Jul 07 03:48:05 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:05 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 7.177s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211d798-0c40-47ff-aa53-cc0cbec976f3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f0f6c11-2f9e-4904-9702-ef47f2ae579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbde18b-346c-4ff8-88c1-da81065224e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Volume volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 (0d899ea5-7e4b-44c5-89fb-1cb3da7658b6): created successfully
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbde18b-346c-4ff8-88c1-da81065224e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Flow 'volume_create_manager' (1e2f7a10-1be0-4af9-8c7e-50ffc132d41e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-62ff3d52-84c3-4e9d-be82-cb9e3794f8c9 tempest-CreateVolumesFromImageTest-401066564 None] Created volume successfully.
Jul 07 03:48:06 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:48:06 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Flow 'volume_create_manager' (901e0dbd-f0b0-41d4-ae26-f39121ca7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82744174-8910-4431-91be-3eaa38108e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82744174-8910-4431-91be-3eaa38108e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-797303510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5766648e-6453-4c6c-a30e-c23ddaad27f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a5fed380c0459e85b0c663fd782831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:06Z,use_quota=True,user_id='5dcc5ef4edf74937bf4745d98112503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cc328-b8ad-4a43-ac78-625409ab9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174cc328-b8ad-4a43-ac78-625409ab9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc08465-2d6f-4715-979a-4741961183dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc08465-2d6f-4715-979a-4741961183dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5766648e-6453-4c6c-a30e-c23ddaad27f7', 'volume_name': 'volume-5766648e-6453-4c6c-a30e-c23ddaad27f7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec187b3b-4be9-43cf-a223-8f31280a566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec187b3b-4be9-43cf-a223-8f31280a566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a48513-7468-45bc-a2a0-90fefca1f767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume 5766648e-6453-4c6c-a30e-c23ddaad27f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5766648e-6453-4c6c-a30e-c23ddaad27f7', 'volume_size': 1}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-quobyte-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ad321-2269-45e2-add3-d2eddecf35ec]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:06 devstack sudo[100826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6
Jul 07 03:48:06 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:06 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Flow 'volume_create_manager' (57ff9501-41fa-4a53-9ec1-bc83e34ec175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690d070a-7722-4099-833d-23c6ff17ed88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 1.116s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690d070a-7722-4099-833d-23c6ff17ed88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-917555625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bf1d3b-4155-47c8-b25d-33ff9762c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a5fed380c0459e85b0c663fd782831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:07Z,use_quota=True,user_id='5dcc5ef4edf74937bf4745d98112503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b124cb1b-06a4-4977-8dd5-87a5fb04ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b124cb1b-06a4-4977-8dd5-87a5fb04ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e366bdb2-7e52-45b2-b897-52ca7bf69be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e366bdb2-7e52-45b2-b897-52ca7bf69be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89bf1d3b-4155-47c8-b25d-33ff9762c03a', 'volume_name': 'volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50892c-d2b1-4092-9e0f-73fc7cef183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df50892c-d2b1-4092-9e0f-73fc7cef183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c3f21d-94e7-435a-b33e-dce7d31c30f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume 89bf1d3b-4155-47c8-b25d-33ff9762c03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a', 'volume_size': 1}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd9646-e696-4b1d-9d28-5579812f270b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:07 devstack sudo[100831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:48:07 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:07 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" returned: 0 in 0.998s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:07 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6
Jul 07 03:48:07 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:07 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.868s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:07 devstack sudo[100841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img
Jul 07 03:48:07 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:08 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" returned: 0 in 0.715s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6" released by "delete_volume" :: held 1.779s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Created reservations ['2d23ccae-714c-4792-ac61-07da5cb16f30', '4fd7b7e0-6bac-4ae5-884c-5af32fcf5b61', '9b966be7-b637-45e4-bec3-e0f920b19b94', 'accf21ee-0097-40d3-9c1d-9490991ad446'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:08 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:08 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-7e5b32eb-f7db-4a08-a791-2e8480f016d3-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-7e5b32eb-f7db-4a08-a791-2e8480f016d3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-quobyte-7e5b32eb-f7db-4a08-a791-2e8480f016d3" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-7e5b32eb-f7db-4a08-a791-2e8480f016d3" acquired by "delete_volume" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7d7cb-af8b-418d-8f59-781d1b2658a5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:09 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3
Jul 07 03:48:09 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:09 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.200s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:09 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Deleted volume successfully.
Jul 07 03:48:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c1da1c0a-9b06-4ae7-8f3c-7b41ed2338c5 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-0d899ea5-7e4b-44c5-89fb-1cb3da7658b6-delete_volume" released by "delete_volume" :: held 3.455s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:10 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3" returned: 0 in 2.109s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:11 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3
Jul 07 03:48:11 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:12 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e5b32eb-f7db-4a08-a791-2e8480f016d3" returned: 0 in 1.688s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-7e5b32eb-f7db-4a08-a791-2e8480f016d3" released by "delete_volume" :: held 3.944s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Created reservations ['e2328cb6-e3d3-428a-96b5-daba27307ece', '63bb7176-b5d8-4aeb-ad82-49eff5cb6309', '741780ad-0012-49d1-9ede-3c17d94dbb38', '192cbbd1-6576-4631-a275-79592e5728d4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:13 devstack sudo[100871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:13 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-37bb8094-1d39-4ff3-860d-d8aa6ad71777-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-37bb8094-1d39-4ff3-860d-d8aa6ad71777-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:13 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img" returned: 0 in 5.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-quobyte-37bb8094-1d39-4ff3-860d-d8aa6ad71777" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-37bb8094-1d39-4ff3-860d-d8aa6ad71777" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[73462868-876a-4da5-b807-a2cc4ad6c174]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cfe096-81bd-427f-9482-b8e58ca0a7aa]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:13 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:48:13 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:13 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777
Jul 07 03:48:13 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:14 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.933s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Deleted volume successfully.
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22ba43fb-a096-4e21-861f-13e0beb43ace tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-7e5b32eb-f7db-4a08-a791-2e8480f016d3-delete_volume" released by "delete_volume" :: held 5.443s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:14 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:14 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777
Jul 07 03:48:14 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:14 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.972s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:48:14 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Converted 1024.00 MB image at 175.67 MB/s
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] 8f1ae6c0-ddc1-4536-b62d-bb9668ea15e7 was raw, converting to qcow2 {{(pid=86955) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52d3338-6ce0-42a2-9f39-c3ed630eed8e]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:14 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img
Jul 07 03:48:14 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:15 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-37bb8094-1d39-4ff3-860d-d8aa6ad71777" returned: 0 in 0.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-37bb8094-1d39-4ff3-860d-d8aa6ad71777" released by "delete_volume" :: held 1.448s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Created reservations ['c7336610-2121-4d00-b425-5cde6e6b4a6a', '7ef21a14-de40-4938-b0cb-0850d3d8f4b8', '2dfa74d0-ebac-4cda-bcd6-a28fa6571212', '60c6639d-6347-49c4-9fe8-7edd4ebb6dcd'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:15 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:15 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:15 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:15 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:15 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:15 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img
Jul 07 03:48:15 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-quobyte-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:16 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.682s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bdeb70-019e-441a-8a39-e77a369aeb85]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:16 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c
Jul 07 03:48:16 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:16 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.803s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Deleted volume successfully.
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-366d1f52-8e78-4430-be50-952a9e2b536d tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-37bb8094-1d39-4ff3-860d-d8aa6ad71777-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:16 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img" returned: 1 in 0.789s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:16 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w
Jul 07 03:48:16 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:16 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:16 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c
Jul 07 03:48:16 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:17 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w" returned: 0 in 0.726s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Image conversion details: src /opt/stack/data/cinder/conversion/f62bb84d-21fc-410c-8174-76d85e9510c6.temp_image.8f1ae6c0-ddc1-4536-b62d-bb9668ea15e71y1i1py7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:48:17 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f55049-533b-43d7-9a38-dde76e7fd405]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:17 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w
Jul 07 03:48:17 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:17 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" returned: 0 in 0.678s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c" released by "delete_volume" :: held 1.523s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Created reservations ['7fee2821-ce4d-4d6d-8279-16482682f88d', '59673588-6a5d-4834-bbf7-be01152b669c', '296c5099-eeba-4063-b721-77ce41845d5d', 'c4e28b8a-f8df-492c-9c4e-e326c108ff7d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:17 devstack sudo[100921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:17 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:17 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_rpl01a6w" returned: 0 in 0.874s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-afd6504d-37a6-406a-94e8-a5b6a57bbbe2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-afd6504d-37a6-406a-94e8-a5b6a57bbbe2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "cinder-quobyte-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8029c877-a42d-4fd0-b07e-867be120ee41]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:18 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2
Jul 07 03:48:18 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:18 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Deleted volume successfully.
Jul 07 03:48:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-45ab77a1-2613-4117-bb25-c67b375eeac8 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-2b2a9f85-aa48-41f9-8ef1-c21e47f9425c-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:19 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:19 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2
Jul 07 03:48:19 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.967s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Uploaded volume to glance image-id: 8f1ae6c0-ddc1-4536-b62d-bb9668ea15e7. {{(pid=86955) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.269s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-797303510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5766648e-6453-4c6c-a30e-c23ddaad27f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a5fed380c0459e85b0c663fd782831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:06Z,use_quota=True,user_id='5dcc5ef4edf74937bf4745d98112503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Creating volume 5766648e-6453-4c6c-a30e-c23ddaad27f7 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:19 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-387cd19b-a5b6-44e9-950b-e83874252c51 tempest-VolumesActionsTest-399469098 None] Copy volume to image completed successfully.
Jul 07 03:48:19 devstack sudo[100951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 1073741824
Jul 07 03:48:19 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:20 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" returned: 0 in 0.927s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-quobyte-afd6504d-37a6-406a-94e8-a5b6a57bbbe2" released by "delete_volume" :: held 1.819s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Created reservations ['cb4790cd-d809-419d-8b4c-926177125c2d', '0cbd2f5b-82a4-44e1-bf41-501005db7d02', 'd202b0fb-3d55-4597-aab0-71599f8dfd01', '96728886-9b0b-4d1c-a8c7-65de67bf6a07'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:20 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:20 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:20 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 1073741824" returned: 0 in 1.023s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:20 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7
Jul 07 03:48:20 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:21 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Deleted volume successfully.
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7f95e9a-ae41-4a7d-9a9a-2e1de114dec7 tempest-CreateVolumesFromImageTest-401066564 None] Lock "cinder-afd6504d-37a6-406a-94e8-a5b6a57bbbe2-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Acquiring lock "cinder-quobyte-f62bb84d-21fc-410c-8174-76d85e9510c6" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "cinder-quobyte-f62bb84d-21fc-410c-8174-76d85e9510c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:21 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7" returned: 0 in 0.780s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.675s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-917555625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bf1d3b-4155-47c8-b25d-33ff9762c03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a5fed380c0459e85b0c663fd782831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:07Z,use_quota=True,user_id='5dcc5ef4edf74937bf4745d98112503c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Creating volume 89bf1d3b-4155-47c8-b25d-33ff9762c03a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:21 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3053669-e133-4730-a78e-7711f56acb74]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:21 devstack sudo[100966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a 1073741824
Jul 07 03:48:21 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a48513-7468-45bc-a2a0-90fefca1f767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5766648e-6453-4c6c-a30e-c23ddaad27f7', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07226deb-1267-49d3-b06d-575ceac9ac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:21 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 (5766648e-6453-4c6c-a30e-c23ddaad27f7): created successfully
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07226deb-1267-49d3-b06d-575ceac9ac04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Flow 'volume_create_manager' (901e0dbd-f0b0-41d4-ae26-f39121ca7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b9a2154b-dd43-4197-81df-27d1ccfcdcda tempest-TestServerVolumeAttachmentScenario-1400649032 None] Created volume successfully.
Jul 07 03:48:21 devstack sudo[100967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:48:21 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:22 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.964s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:22 devstack sudo[100979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6
Jul 07 03:48:22 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:22 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a 1073741824" returned: 0 in 1.040s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:22 devstack sudo[100981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a
Jul 07 03:48:22 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:23 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f62bb84d-21fc-410c-8174-76d85e9510c6" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "cinder-quobyte-f62bb84d-21fc-410c-8174-76d85e9510c6" released by "delete_volume" :: held 1.759s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Created reservations ['491f2f56-59f2-4157-ae2f-1d82beaba900', '32f55469-bb6f-4edd-9078-7de7e7a7c36c', 'a445ee99-22ce-41ca-abee-5e15bc79afb8', '59beeab7-d2f6-432c-9fa1-2894480556d7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:23 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a" returned: 0 in 0.744s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30c3f21d-94e7-435a-b33e-dce7d31c30f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfa270e-af3d-4ce9-9679-89a5fb3eb965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Volume volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a (89bf1d3b-4155-47c8-b25d-33ff9762c03a): created successfully
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfa270e-af3d-4ce9-9679-89a5fb3eb965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Flow 'volume_create_manager' (57ff9501-41fa-4a53-9ec1-bc83e34ec175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-953494e8-c60a-4c5a-9233-102b6cc9ad6a tempest-TestServerVolumeAttachmentScenario-1400649032 None] Created volume successfully.
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:23 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:23 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Flow 'volume_create_manager' (01ee5262-6324-4dc6-905f-347d93538aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ee764c-44d6-4aa9-9f72-3134fc98f8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ee764c-44d6-4aa9-9f72-3134fc98f8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1362242451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640aeddf-3ad3-43d6-9947-c9c41da7d69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cf0cc1f1f44baeaf5454ec86f41fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:24Z,use_quota=True,user_id='e151a92d59ab418bae47a1e624d0b77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846f391-d626-4f6c-9b77-fb9acf7215fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c846f391-d626-4f6c-9b77-fb9acf7215fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b7a3eb-a2da-4644-ac02-6be7e6473282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b7a3eb-a2da-4644-ac02-6be7e6473282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '640aeddf-3ad3-43d6-9947-c9c41da7d69f', 'volume_name': 'volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77499690-4cb0-4d9e-9965-1697c5fb17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77499690-4cb0-4d9e-9965-1697c5fb17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d81c5b-9951-4050-a76c-5a80d17c32b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Volume 640aeddf-3ad3-43d6-9947-c9c41da7d69f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f', 'volume_size': 1}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1362242451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=640aeddf-3ad3-43d6-9947-c9c41da7d69f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cf0cc1f1f44baeaf5454ec86f41fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:24Z,use_quota=True,user_id='e151a92d59ab418bae47a1e624d0b77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Creating volume 640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:24 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:24 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f 1073741824
Jul 07 03:48:24 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:24 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.173s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Deleted volume successfully.
Jul 07 03:48:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8886c5f2-3cac-4768-a932-251c1bb8695c tempest-VolumesActionsTest-399469098 None] Lock "cinder-f62bb84d-21fc-410c-8174-76d85e9510c6-delete_volume" released by "delete_volume" :: held 3.345s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:25 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f 1073741824" returned: 0 in 1.098s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:25 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:25 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:26 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.792s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d81c5b-9951-4050-a76c-5a80d17c32b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19072496-3119-434f-8090-5f3739d6178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Volume volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f (640aeddf-3ad3-43d6-9947-c9c41da7d69f): created successfully
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19072496-3119-434f-8090-5f3739d6178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Flow 'volume_create_manager' (01ee5262-6324-4dc6-905f-347d93538aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-aa49ba70-69b7-4262-94b9-02bbc1fcf268 tempest-VolumeDependencyTests-1700670289 None] Created volume successfully.
Jul 07 03:48:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Creating offline snapshot 0d9fdf1f-59f9-40be-9575-070110660c1c of volume 640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:48:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6adccdb-46f4-4abb-8126-bf59ab2c2b6d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:28 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:28 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:28 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.865s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:28 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c 1G
Jul 07 03:48:28 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:29 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c 1G" returned: 0 in 1.118s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:29 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:29 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:30 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.888s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:30 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c is being set with open permissions: ugo+rw
Jul 07 03:48:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:30 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:30 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Flow 'volume_create_manager' (4dfc84ee-0888-48ec-b9f8-e12a76822a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2510d2c-28db-4970-a89e-c1eddc6584e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2510d2c-28db-4970-a89e-c1eddc6584e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1657014293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c8b195-efbb-4477-855b-681a7e13f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30c902a68be40e8abc2ca3fefccc151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:31Z,use_quota=True,user_id='3c7e924b79344feda17bcca49930c020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a3b1f4-d6f4-446e-bfc2-cacbd324a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a3b1f4-d6f4-446e-bfc2-cacbd324a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b42294c-a04e-47e3-ba28-08f4f9e03e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b42294c-a04e-47e3-ba28-08f4f9e03e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6c8b195-efbb-4477-855b-681a7e13f2c4', 'volume_name': 'volume-b6c8b195-efbb-4477-855b-681a7e13f2c4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bec5127-c611-46c9-ad2a-dbfb83d92b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bec5127-c611-46c9-ad2a-dbfb83d92b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371cb701-9b0b-4b74-a047-215490da2428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Volume b6c8b195-efbb-4477-855b-681a7e13f2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6c8b195-efbb-4477-855b-681a7e13f2c4', 'volume_size': 1}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:31 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.688s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:31 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info
Jul 07 03:48:31 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:32 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info" returned: 0 in 0.689s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:32 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info is being set with open permissions: ugo+rw
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:32 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info
Jul 07 03:48:32 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:32 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.info" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1657014293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6c8b195-efbb-4477-855b-681a7e13f2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30c902a68be40e8abc2ca3fefccc151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:31Z,use_quota=True,user_id='3c7e924b79344feda17bcca49930c020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Creating volume b6c8b195-efbb-4477-855b-681a7e13f2c4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:32 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:48:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:32 devstack sudo[101094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 1073741824
Jul 07 03:48:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8f68cbb1-4f1a-43c7-b5f9-7d5e04676043 tempest-VolumeDependencyTests-1700670289 None] Create snapshot completed successfully
Jul 07 03:48:32 devstack sudo[101094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Flow 'volume_create_manager' (1b925dc9-85a5-4013-a60f-9227e79f8fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7fd90d-73f9-48b6-866c-af648af363ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7fd90d-73f9-48b6-866c-af648af363ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6387267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59143637-87d0-4347-808b-58b9bae1f16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cf0cc1f1f44baeaf5454ec86f41fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d9fdf1f-59f9-40be-9575-070110660c1c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:48:34Z,use_quota=True,user_id='e151a92d59ab418bae47a1e624d0b77c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:33 devstack sudo[101094]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63faff4-9ac6-4a25-8377-04ddaf0637d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63faff4-9ac6-4a25-8377-04ddaf0637d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec30311-6b3c-4ffb-a976-d95bb58db962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec30311-6b3c-4ffb-a976-d95bb58db962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59143637-87d0-4347-808b-58b9bae1f16d', 'volume_name': 'volume-59143637-87d0-4347-808b-58b9bae1f16d', 'volume_size': 1, 'snapshot_id': '0d9fdf1f-59f9-40be-9575-070110660c1c'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdd2327-7a63-4226-b5f6-3b6a405ff5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdd2327-7a63-4226-b5f6-3b6a405ff5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2078037d-f07c-4f25-ae65-372133b2368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Volume 59143637-87d0-4347-808b-58b9bae1f16d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59143637-87d0-4347-808b-58b9bae1f16d', 'volume_size': 1, 'snapshot_id': '0d9fdf1f-59f9-40be-9575-070110660c1c'}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 1073741824" returned: 0 in 0.933s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:33 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4
Jul 07 03:48:33 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:34 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.690s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c-59143637-87d0-4347-808b-58b9bae1f16d" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c-59143637-87d0-4347-808b-58b9bae1f16d" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Creating volume 59143637-87d0-4347-808b-58b9bae1f16d from snapshot 0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371cb701-9b0b-4b74-a047-215490da2428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6c8b195-efbb-4477-855b-681a7e13f2c4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb4fb63-e7ec-479f-89e5-38e4dc7405b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] snapshot: 0d9fdf1f-59f9-40be-9575-070110660c1c, volume: 59143637-87d0-4347-808b-58b9bae1f16d,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:48:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Volume volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 (b6c8b195-efbb-4477-855b-681a7e13f2c4): created successfully
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb4fb63-e7ec-479f-89e5-38e4dc7405b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Flow 'volume_create_manager' (4dfc84ee-0888-48ec-b9f8-e12a76822a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f9ec4231-8b6b-4591-9a56-081da7c3cd95 tempest-VolumesNegativeTest-305975317 None] Created volume successfully.
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa79a44-c2f9-4c48-a388-cb7b249ac5aa]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:34 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:34 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:35 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.820s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5628e37d-c85c-476e-9bf9-88bd2e8b56d0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:35 devstack sudo[101108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:35 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:36 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:36 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:48:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:36 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d
Jul 07 03:48:36 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d" returned: 0 in 5.494s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dc5fdf-1ced-4566-b713-a7e3fc56af6b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:42 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:42 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:42 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 1.020s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:42 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:48:42 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Converted 1024.00 MB image at 186.28 MB/s
Jul 07 03:48:42 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d is being set with open permissions: ugo+rw
Jul 07 03:48:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:42 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d
Jul 07 03:48:43 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:43 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" released by "_copy_volume_from_snapshot" :: held 9.139s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c-59143637-87d0-4347-808b-58b9bae1f16d" released by "_create_volume_from_snapshot" :: held 9.195s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.215s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2078037d-f07c-4f25-ae65-372133b2368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59143637-87d0-4347-808b-58b9bae1f16d', 'volume_size': 1, 'snapshot_id': '0d9fdf1f-59f9-40be-9575-070110660c1c'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536e7ea9-7c03-46a9-bf5f-1ec6c1558926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:48:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Volume volume-59143637-87d0-4347-808b-58b9bae1f16d (59143637-87d0-4347-808b-58b9bae1f16d): created successfully
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536e7ea9-7c03-46a9-bf5f-1ec6c1558926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:48:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Flow 'volume_create_manager' (1b925dc9-85a5-4013-a60f-9227e79f8fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:48:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1eb780c4-c582-47e2-9629-ffe2695a8298 tempest-VolumeDependencyTests-1700670289 None] Created volume successfully.
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-0d9fdf1f-59f9-40be-9575-070110660c1c-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-0d9fdf1f-59f9-40be-9575-070110660c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Deleting offline snapshot 0d9fdf1f-59f9-40be-9575-070110660c1c of volume 640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] snapshot_file for this snap is: volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff696329-0a91-44ed-9104-3b6e00acb53e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:44 devstack sudo[101215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:44 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:45 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.759s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:48:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1a381e-b008-42e0-b86a-c43380909eee]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:45 devstack sudo[101220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:45 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:46 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.780s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:46 devstack sudo[101225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:46 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:47 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:47 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c
Jul 07 03:48:47 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:48 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f.0d9fdf1f-59f9-40be-9575-070110660c1c" returned: 0 in 0.934s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-0d9fdf1f-59f9-40be-9575-070110660c1c" released by "_delete_snapshot" :: held 3.376s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" released by "delete_snapshot" :: held 3.401s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Created reservations ['1dbf4be5-b815-41d7-bb9f-2e1f76ca3124', '7b2469dd-48d0-43eb-be05-492439e21642', '6fe15661-6496-4d48-a811-5916a3daa162', '478eca18-f274-459e-862c-b6d1cc5643e6'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Delete snapshot completed successfully.
Jul 07 03:48:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5741be1d-f20f-4c18-bb18-a92987d82892 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-0d9fdf1f-59f9-40be-9575-070110660c1c-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-640aeddf-3ad3-43d6-9947-c9c41da7d69f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-640aeddf-3ad3-43d6-9947-c9c41da7d69f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=89,cinder:SELECT=59,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=56,cinder:INSERT=23,cinder:DELETE=9,cinder:UPDATE=77 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370dbfa-8251-417e-941f-f5598f3c8a25]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:49 devstack sudo[101280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:49 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:49 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.782s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:49 devstack sudo[101305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f
Jul 07 03:48:49 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:50 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-640aeddf-3ad3-43d6-9947-c9c41da7d69f" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-640aeddf-3ad3-43d6-9947-c9c41da7d69f" released by "delete_volume" :: held 1.626s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Created reservations ['e244160a-b2af-4f95-8bb0-7adb034d07ab', 'e53a3a15-364d-4f17-a799-0b74194a7755', '82dad18b-1779-441c-a762-0308bdbed0bf', 'b6d3adef-8573-4c7e-a124-14065c707b45'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:50 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:50 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-59143637-87d0-4347-808b-58b9bae1f16d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-59143637-87d0-4347-808b-58b9bae1f16d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[270747ee-47e7-4122-85dc-58da5ebb5d2d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:51 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d
Jul 07 03:48:51 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:51 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.941s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Deleted volume successfully.
Jul 07 03:48:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1879a6bb-b4bc-4534-bd32-0872990b528d tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-640aeddf-3ad3-43d6-9947-c9c41da7d69f-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:52 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d" returned: 0 in 0.955s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:52 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d
Jul 07 03:48:52 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:53 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-59143637-87d0-4347-808b-58b9bae1f16d" returned: 0 in 0.673s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-quobyte-59143637-87d0-4347-808b-58b9bae1f16d" released by "delete_volume" :: held 1.680s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Created reservations ['c2f69f8f-3ef6-43c0-8769-4c9ca33deff6', '9d2a76c5-a5c6-4a42-b5c4-190770e537c0', 'f776d48c-6411-4673-94c4-f0ce07cc91e2', '4069aae7-b53a-447e-8e69-1deb8f52f4bf'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:53 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:48:53 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:53 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.736s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:48:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Deleted volume successfully.
Jul 07 03:48:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-ad8778e3-3d36-44c6-811b-11f9fc17ad80 tempest-VolumeDependencyTests-1700670289 None] Lock "cinder-59143637-87d0-4347-808b-58b9bae1f16d-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:48:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:48:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:48:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[987f5cc0-3a0e-4f2a-b5af-30a791afb1aa]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:48:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:48:54 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7
Jul 07 03:48:54 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:48:55 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Jul 07 03:48:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7" returned: 0 in 0.951s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:48:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.974s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:48:55 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-5766648e-6453-4c6c-a30e-c23ddaad27f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '061ecc3d-7130-40f6-b115-4cb45cacf1fa', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:48:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-39e0676f-1208-48a7-a4f0-915f70df00fb req-78122e90-9639-45ed-8d91-4402ec87385d tempest-TestServerVolumeAttachmentScenario-1400649032 None] attachment_update completed successfully.
Jul 07 03:49:05 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=13,cinder:INSERT=3,cinder:UPDATE=17 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:49:05 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Acquiring lock "cinder-b6c8b195-efbb-4477-855b-681a7e13f2c4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "cinder-b6c8b195-efbb-4477-855b-681a7e13f2c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ac585f-4054-43d8-a1b4-e4932888418c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Acquiring lock "cinder-quobyte-b6c8b195-efbb-4477-855b-681a7e13f2c4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "cinder-quobyte-b6c8b195-efbb-4477-855b-681a7e13f2c4" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa3b35-9312-4252-818d-3a4af505568b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:06 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a
Jul 07 03:49:06 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:06 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4
Jul 07 03:49:06 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:07 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a" returned: 0 in 0.879s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.910s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c251b42-abfc-4dc0-8b97-ab5569448c5b', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:49:07 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4" returned: 0 in 0.872s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:07 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4
Jul 07 03:49:07 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-56f429c8-86cf-4086-83ee-09d77b804d5f req-d5be1383-bfb1-4a66-ae16-a1c0e7b08bc0 tempest-TestServerVolumeAttachmentScenario-1400649032 None] attachment_update completed successfully.
Jul 07 03:49:07 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b6c8b195-efbb-4477-855b-681a7e13f2c4" returned: 0 in 0.700s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "cinder-quobyte-b6c8b195-efbb-4477-855b-681a7e13f2c4" released by "delete_volume" :: held 1.637s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Created reservations ['022c17fc-6638-4d2d-b75e-455c8850246e', 'd0dc291e-969c-4445-969f-69f5bbd1add5', '0c22835f-65ed-4f1e-9d8b-ba37b67abf10', '5379b1c2-cb88-4491-82aa-badb5c7751b3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:08 devstack sudo[101789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:08 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:08 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.836s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:08 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Deleted volume successfully.
Jul 07 03:49:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-9f5c5781-9178-4a42-ac2b-4d57717364f2 tempest-VolumesNegativeTest-305975317 None] Lock "cinder-b6c8b195-efbb-4477-855b-681a7e13f2c4-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Flow 'volume_create_manager' (b15cb85d-9798-4ab5-aeec-5498ae5ccb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96c3a28-b8e4-4da0-8e56-8acd125f1efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96c3a28-b8e4-4da0-8e56-8acd125f1efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-509564310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c50d65-d1ed-4c38-b3ba-1b3799d969a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b801bd6954dfeb920069ac455953a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:49:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:49:11Z,use_quota=True,user_id='38b4e4b12b194105a572ca94d4a7f8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b693009b-4f5d-4810-b373-4a1fb76389a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b693009b-4f5d-4810-b373-4a1fb76389a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7026ff9-ecc1-4020-a374-1969b3be7743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7026ff9-ecc1-4020-a374-1969b3be7743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c50d65-d1ed-4c38-b3ba-1b3799d969a8', 'volume_name': 'volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33246468-b57c-4244-8ca9-e844606c8d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33246468-b57c-4244-8ca9-e844606c8d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791917e-91a7-4713-84fa-8bc7e1cd074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:11 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Volume 56c50d65-d1ed-4c38-b3ba-1b3799d969a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8', 'volume_size': 2}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-509564310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c50d65-d1ed-4c38-b3ba-1b3799d969a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6b801bd6954dfeb920069ac455953a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:49:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:49:11Z,use_quota=True,user_id='38b4e4b12b194105a572ca94d4a7f8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Creating volume 56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:49:11 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:49:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 2147483648 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:11 devstack sudo[101796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 2147483648
Jul 07 03:49:11 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:12 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 2147483648" returned: 0 in 0.994s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:12 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8
Jul 07 03:49:12 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-93ace3a5-b07c-4ca1-b45b-1dffd2d10897 req-fab920cf-d266-437b-8054-438d7c901a9d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Terminate volume connection completed successfully.
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-93ace3a5-b07c-4ca1-b45b-1dffd2d10897 req-fab920cf-d266-437b-8054-438d7c901a9d tempest-TestServerVolumeAttachmentScenario-1400649032 None] Deleting attachment 2c251b42-abfc-4dc0-8b97-ab5569448c5b. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:49:13 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" returned: 0 in 0.732s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6791917e-91a7-4713-84fa-8bc7e1cd074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8', 'volume_size': 2}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e828013-460f-4c0e-aa14-d8526772e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Volume volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 (56c50d65-d1ed-4c38-b3ba-1b3799d969a8): created successfully
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e828013-460f-4c0e-aa14-d8526772e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Flow 'volume_create_manager' (b15cb85d-9798-4ab5-aeec-5498ae5ccb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2973e9b2-b3cb-4420-8241-21b4ffac99f5 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Created volume successfully.
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Creating offline snapshot 325a0cc1-411f-4432-844e-b781921a6233 of volume 56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42ef37-2305-4a1f-a050-2c8f69333290]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:13 devstack sudo[101807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8
Jul 07 03:49:13 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:14 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" returned: 0 in 1.022s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 2G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:14 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 2G
Jul 07 03:49:14 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:15 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:15 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:15 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 2G" returned: 0 in 1.229s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:16 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233
Jul 07 03:49:16 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:16 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.953s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:49:16 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233" returned: 0 in 0.833s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:16 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 is being set with open permissions: ugo+rw
Jul 07 03:49:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:16 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233
Jul 07 03:49:16 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8126e800-d7d2-42ec-a77d-5caddc58cdb8 req-88285b17-478c-4be1-8bf3-c64de8efbc32 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Terminate volume connection completed successfully.
Jul 07 03:49:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8126e800-d7d2-42ec-a77d-5caddc58cdb8 req-88285b17-478c-4be1-8bf3-c64de8efbc32 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Deleting attachment 061ecc3d-7130-40f6-b115-4cb45cacf1fa. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:49:17 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233" returned: 0 in 0.740s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:17 devstack sudo[101855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info
Jul 07 03:49:17 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:18 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info" returned: 0 in 0.824s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info is being set with open permissions: ugo+rw
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:18 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info
Jul 07 03:49:18 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Flow 'volume_create_manager' (5e66258c-ca52-4983-b59c-84fd0b88c199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40919e2-16c9-4a11-bcbe-bf6f152b4e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40919e2-16c9-4a11-bcbe-bf6f152b4e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1518109239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4179a6bc-3ae6-46b8-b2c0-d9f2079773d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cb934b205544b4b67cdf6243afa7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:49:19Z,use_quota=True,user_id='af0f7609876b4a7191a2f865dcd1bb2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181e1a3-4a0d-4ab1-b850-bea3109c42d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181e1a3-4a0d-4ab1-b850-bea3109c42d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a161a-2fdd-4ccf-b672-23acbccd1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5a161a-2fdd-4ccf-b672-23acbccd1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4179a6bc-3ae6-46b8-b2c0-d9f2079773d4', 'volume_name': 'volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c281c1-36e1-48aa-a7b7-0e29c8afd94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c281c1-36e1-48aa-a7b7-0e29c8afd94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9934b3bb-833e-4143-ab73-a86cc5002179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Volume 4179a6bc-3ae6-46b8-b2c0-d9f2079773d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4', 'volume_size': 1}
Jul 07 03:49:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:19 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.info" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.434s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.267s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1518109239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4179a6bc-3ae6-46b8-b2c0-d9f2079773d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cb934b205544b4b67cdf6243afa7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:49:19Z,use_quota=True,user_id='af0f7609876b4a7191a2f865dcd1bb2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Creating volume 4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:49:19 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:19 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 1073741824
Jul 07 03:49:19 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-923205b5-6348-4a83-b6ce-8a80c3b592ee tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Create snapshot completed successfully
Jul 07 03:49:19 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 1073741824" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:20 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:20 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "cinder-325a0cc1-411f-4432-844e-b781921a6233-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-325a0cc1-411f-4432-844e-b781921a6233-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "cinder-quobyte-325a0cc1-411f-4432-844e-b781921a6233" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-325a0cc1-411f-4432-844e-b781921a6233" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Deleting offline snapshot 325a0cc1-411f-4432-844e-b781921a6233 of volume 56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] snapshot_file for this snap is: volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed48db2-ba0c-404a-b36c-67c4a02cacb0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:20 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233
Jul 07 03:49:20 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:20 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9934b3bb-833e-4143-ab73-a86cc5002179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036beedd-422a-4df6-8af3-941e39b67f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Volume volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 (4179a6bc-3ae6-46b8-b2c0-d9f2079773d4): created successfully
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036beedd-422a-4df6-8af3-941e39b67f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Flow 'volume_create_manager' (5e66258c-ca52-4983-b59c-84fd0b88c199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-517acd0b-e4dc-455f-85dd-06882a1292cf tempest-SnapshotDependencyTests-2048881299 None] Created volume successfully.
Jul 07 03:49:21 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233" returned: 0 in 0.800s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad44c62-11e4-4252-98ec-c496dbafe94e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:21 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8
Jul 07 03:49:21 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:21 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" returned: 0 in 0.880s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:21 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233
Jul 07 03:49:21 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Creating offline snapshot b4f606c6-cf6b-451a-a324-1fc9f73895ce of volume 4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c22a9a-d448-43d9-8e51-33dba78461f1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:22 devstack sudo[101908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:22 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:22 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:22 devstack sudo[101916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233
Jul 07 03:49:22 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:23 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.899s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:23 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce 1G
Jul 07 03:49:23 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:23 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8.325a0cc1-411f-4432-844e-b781921a6233" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-325a0cc1-411f-4432-844e-b781921a6233" released by "_delete_snapshot" :: held 3.385s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" released by "delete_snapshot" :: held 3.407s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Created reservations ['113468c5-3f42-4fab-8ebc-7bfc5cd4405a', '40fd1ff3-9183-4437-a003-e13204e176f1', 'f27c1b45-3bf2-4635-9930-67d503888a86', '8a5c97ea-fb73-410a-87e6-9ecb17e943e8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Delete snapshot completed successfully.
Jul 07 03:49:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-853fbec8-019a-4728-9315-b732dfa928cc tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-325a0cc1-411f-4432-844e-b781921a6233-delete_snapshot" released by "delete_snapshot" :: held 3.557s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:24 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce 1G" returned: 0 in 0.826s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:24 devstack sudo[101928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:24 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "cinder-56c50d65-d1ed-4c38-b3ba-1b3799d969a8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-56c50d65-d1ed-4c38-b3ba-1b3799d969a8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e73b9-9b89-45f5-97b2-a0939e30774d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:24 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8
Jul 07 03:49:24 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:24 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.704s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:24 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce is being set with open permissions: ugo+rw
Jul 07 03:49:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:24 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:24 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:25 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:25 devstack sudo[101941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8
Jul 07 03:49:25 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:25 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.687s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:25 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info
Jul 07 03:49:25 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:26 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-quobyte-56c50d65-d1ed-4c38-b3ba-1b3799d969a8" released by "delete_volume" :: held 1.513s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Created reservations ['2565927c-0be2-4a59-841c-056a1e0e2ddb', 'e22ab7b3-e99b-4b11-8613-90e449608489', 'd6870358-27f3-485a-9e4d-c0f91bdb9bcc', 'cf40dad1-e340-4d38-b404-e5cf247ad4fb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:26 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info" returned: 0 in 0.671s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:26 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info is being set with open permissions: ugo+rw
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:26 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info
Jul 07 03:49:26 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:26 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:26 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:26 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:26 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.info" returned: 0 in 0.768s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Deleted volume successfully.
Jul 07 03:49:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dc7a4428-91c5-486b-a02e-f62e71f72f88 tempest-SnapshotDependencyTests-2048881299 None] Create snapshot completed successfully
Jul 07 03:49:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2084d5f9-5716-4057-b9d9-53270ba5dc77 tempest-VolumesSnapshotNegativeTestJSON-913314904 None] Lock "cinder-56c50d65-d1ed-4c38-b3ba-1b3799d969a8-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "cinder-89bf1d3b-4155-47c8-b25d-33ff9762c03a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-89bf1d3b-4155-47c8-b25d-33ff9762c03a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "cinder-quobyte-89bf1d3b-4155-47c8-b25d-33ff9762c03a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-quobyte-89bf1d3b-4155-47c8-b25d-33ff9762c03a" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[481acd36-f522-41d5-ba89-5bc534edc75c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:27 devstack sudo[101953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a
Jul 07 03:49:27 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Flow 'volume_create_manager' (19f6ba85-8cc3-42f1-a856-b647fd9d7118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b870beef-d998-4aea-a7ea-cc8449f168bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b870beef-d998-4aea-a7ea-cc8449f168bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ec4c58-01c8-49ea-9ed9-e7983acad519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84cb934b205544b4b67cdf6243afa7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4f606c6-cf6b-451a-a324-1fc9f73895ce,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:49:28Z,use_quota=True,user_id='af0f7609876b4a7191a2f865dcd1bb2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6a7d7-095a-4e57-9c47-116c576d3898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b6a7d7-095a-4e57-9c47-116c576d3898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9ebfef-cb33-45f5-b137-469f409de299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9ebfef-cb33-45f5-b137-469f409de299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63ec4c58-01c8-49ea-9ed9-e7983acad519', 'volume_name': 'volume-63ec4c58-01c8-49ea-9ed9-e7983acad519', 'volume_size': 1, 'snapshot_id': 'b4f606c6-cf6b-451a-a324-1fc9f73895ce'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c94d57c-c964-4767-a19e-cf81e1c51d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c94d57c-c964-4767-a19e-cf81e1c51d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be257cc-9cd7-44c6-9329-8cd42c8adfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Volume 63ec4c58-01c8-49ea-9ed9-e7983acad519: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63ec4c58-01c8-49ea-9ed9-e7983acad519', 'volume_size': 1, 'snapshot_id': 'b4f606c6-cf6b-451a-a324-1fc9f73895ce'}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce-63ec4c58-01c8-49ea-9ed9-e7983acad519" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce-63ec4c58-01c8-49ea-9ed9-e7983acad519" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Creating volume 63ec4c58-01c8-49ea-9ed9-e7983acad519 from snapshot b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] snapshot: b4f606c6-cf6b-451a-a324-1fc9f73895ce, volume: 63ec4c58-01c8-49ea-9ed9-e7983acad519,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff87f0-f3ed-4c50-b7f0-10552a32c049]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:28 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a" returned: 0 in 0.894s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:28 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:28 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:28 devstack sudo[101959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a
Jul 07 03:49:28 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:29 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-89bf1d3b-4155-47c8-b25d-33ff9762c03a" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:29 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-quobyte-89bf1d3b-4155-47c8-b25d-33ff9762c03a" released by "delete_volume" :: held 1.623s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.801s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5cf2a2-cc94-41c5-bf47-3b127171ad88]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Created reservations ['80bcc349-991b-4213-9e6f-f31c7bac7bc5', 'b9376080-8b8f-4f1d-8515-dee431f36519', 'df8cd745-92fa-41ef-94a2-e4f3708f7ff7', 'ec14145f-d0ab-4430-8489-ab6516cfe97a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:29 devstack sudo[101967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:29 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:29 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:29 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "cinder-5766648e-6453-4c6c-a30e-c23ddaad27f7-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-5766648e-6453-4c6c-a30e-c23ddaad27f7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "cinder-quobyte-5766648e-6453-4c6c-a30e-c23ddaad27f7" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-quobyte-5766648e-6453-4c6c-a30e-c23ddaad27f7" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca621f26-3e9d-4735-93ad-fcb32b982c02]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:30 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7
Jul 07 03:49:30 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:30 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.823s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:30 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.951s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Deleted volume successfully.
Jul 07 03:49:30 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519
Jul 07 03:49:30 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7cfc119e-64cb-42c4-8729-0e0902b0125e tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-89bf1d3b-4155-47c8-b25d-33ff9762c03a-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:30 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7" returned: 0 in 0.893s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:30 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7
Jul 07 03:49:30 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:32 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5766648e-6453-4c6c-a30e-c23ddaad27f7" returned: 0 in 1.220s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-quobyte-5766648e-6453-4c6c-a30e-c23ddaad27f7" released by "delete_volume" :: held 2.192s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Created reservations ['c459cf18-b944-4122-9a64-8f407c8aa3dc', 'a637e916-9a7f-46ef-b995-fd30741087ab', '05958a52-77cb-43d6-a969-bb19705a1555', '8ad0e967-369b-4acb-b12c-f76b8cdeeed7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:32 devstack sudo[101996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:32 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:33 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.349s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Deleted volume successfully.
Jul 07 03:49:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-8430ecf3-e7fc-4177-b32d-22cdc9780b27 tempest-TestServerVolumeAttachmentScenario-1400649032 None] Lock "cinder-5766648e-6453-4c6c-a30e-c23ddaad27f7-delete_volume" released by "delete_volume" :: held 4.102s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:36 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519" returned: 0 in 6.040s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f961512-32c3-49e1-b66f-4142c66829fd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:36 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:36 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:37 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 1.159s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:37 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:49:37 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Converted 1024.00 MB image at 169.49 MB/s
Jul 07 03:49:37 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 is being set with open permissions: ugo+rw
Jul 07 03:49:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:37 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519
Jul 07 03:49:37 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:38 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" released by "_copy_volume_from_snapshot" :: held 9.826s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce-63ec4c58-01c8-49ea-9ed9-e7983acad519" released by "_create_volume_from_snapshot" :: held 9.862s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.879s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be257cc-9cd7-44c6-9329-8cd42c8adfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ec4c58-01c8-49ea-9ed9-e7983acad519', 'volume_size': 1, 'snapshot_id': 'b4f606c6-cf6b-451a-a324-1fc9f73895ce'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa45e9e-0d9e-4532-8d72-69003d3cc60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:49:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Volume volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 (63ec4c58-01c8-49ea-9ed9-e7983acad519): created successfully
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa45e9e-0d9e-4532-8d72-69003d3cc60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:49:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Flow 'volume_create_manager' (19f6ba85-8cc3-42f1-a856-b647fd9d7118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:49:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4898752d-05cf-4402-b0b8-c0de95f95293 tempest-SnapshotDependencyTests-2048881299 None] Created volume successfully.
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-b4f606c6-cf6b-451a-a324-1fc9f73895ce-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-b4f606c6-cf6b-451a-a324-1fc9f73895ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Deleting offline snapshot b4f606c6-cf6b-451a-a324-1fc9f73895ce of volume 4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] snapshot_file for this snap is: volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579554c-41f0-4759-a1da-d90f3e2f400e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:39 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:39 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:40 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.911s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:49:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5ea79e-40fe-4fde-9e6c-edeaaef33f8d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:40 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:40 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:41 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.909s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:41 devstack sudo[102022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:41 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:42 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.859s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:42 devstack sudo[102028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce
Jul 07 03:49:42 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:43 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4.b4f606c6-cf6b-451a-a324-1fc9f73895ce" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-b4f606c6-cf6b-451a-a324-1fc9f73895ce" released by "_delete_snapshot" :: held 3.605s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" released by "delete_snapshot" :: held 3.645s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Created reservations ['b1ad29f2-8e6e-4b43-999e-590cc56c3409', 'b5e06f61-bcf2-40f3-95c9-7399dc710242', '0f5dfad1-2764-479f-a943-0f8b6fc3334f', '8d552c64-080e-4d4b-9ab0-c5fb520b72c3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Delete snapshot completed successfully.
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe359fb2-1c77-4f2f-a0d5-a14de193bf1c tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-b4f606c6-cf6b-451a-a324-1fc9f73895ce-delete_snapshot" released by "delete_snapshot" :: held 3.812s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3101e87c-b9f4-46e8-bf5f-27a813d0ae05]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:44 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:44 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:44 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:44 devstack sudo[102075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4
Jul 07 03:49:44 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:45 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4" released by "delete_volume" :: held 1.698s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Created reservations ['5b897024-9f30-42ae-90de-93fac812b60a', '4abe5619-c805-4bd1-adc6-7ca669e6e5e1', '64d4a782-7c38-4837-8baf-1c31701d5f7c', '5fb43d50-db1e-4b65-945a-75803819520b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:45 devstack sudo[102078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:45 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-63ec4c58-01c8-49ea-9ed9-e7983acad519-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-63ec4c58-01c8-49ea-9ed9-e7983acad519-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc30b7b-9ac1-4f39-a97f-d83635bac284]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:46 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519
Jul 07 03:49:46 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:46 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.885s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Deleted volume successfully.
Jul 07 03:49:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e5eb2b1-efc1-4ca5-9540-a3a47691a3a2 tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-4179a6bc-3ae6-46b8-b2c0-d9f2079773d4-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:47 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519" returned: 0 in 1.051s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:47 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519
Jul 07 03:49:47 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:48 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-63ec4c58-01c8-49ea-9ed9-e7983acad519" returned: 0 in 0.851s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-quobyte-63ec4c58-01c8-49ea-9ed9-e7983acad519" released by "delete_volume" :: held 1.967s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Created reservations ['c08ab847-4bec-4cb5-95f9-bd147474b729', '524f74ba-99cf-41b1-aede-114dc699a1b3', 'efdf2f40-b071-4539-8961-472d43f9279a', '00114eed-2c36-4dc9-aeaf-de65d2f31acb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:49:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:49:48 devstack sudo[102090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:49:48 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:49:49 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root
Jul 07 03:49:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.671s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:49:49 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:49:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Deleted volume successfully.
Jul 07 03:49:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8b5268a-834b-4fa9-9ef8-c2d5ee7114fe tempest-SnapshotDependencyTests-2048881299 None] Lock "cinder-63ec4c58-01c8-49ea-9ed9-e7983acad519-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:49:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=68,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=5 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:49:59 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=57,cinder:UPDATE=71,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Flow 'volume_create_manager' (4ee45a00-663a-472d-90cb-2f0924c609b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabec6fd-1e81-404b-98fa-e941715eff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabec6fd-1e81-404b-98fa-e941715eff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1296340668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9bb843-ba3e-4f46-a859-678cb6b0c19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec18460e4c446b79ffd48b8972f459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:50:01Z,use_quota=True,user_id='94eb57358fa4469d83328da2f3fdf443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfddeb4e-d796-4524-88d0-8f4ebf0b962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfddeb4e-d796-4524-88d0-8f4ebf0b962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2864f9ae-d5c4-4805-be05-f6a2d8b56e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2864f9ae-d5c4-4805-be05-f6a2d8b56e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9bb843-ba3e-4f46-a859-678cb6b0c19f', 'volume_name': 'volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49098aa-9e4f-48d0-8464-7ff63eef9fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49098aa-9e4f-48d0-8464-7ff63eef9fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5bbd3-6243-457d-8355-ef5e136c976e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Volume df9bb843-ba3e-4f46-a859-678cb6b0c19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f', 'volume_size': 1}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1296340668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9bb843-ba3e-4f46-a859-678cb6b0c19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec18460e4c446b79ffd48b8972f459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:50:01Z,use_quota=True,user_id='94eb57358fa4469d83328da2f3fdf443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Creating volume df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:50:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:50:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:01 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f 1073741824
Jul 07 03:50:01 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:02 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f 1073741824" returned: 0 in 1.103s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:02 devstack sudo[102113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:50:02 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:03 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b5bbd3-6243-457d-8355-ef5e136c976e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d9aeee-3ebb-4214-946c-615664817479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Volume volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f (df9bb843-ba3e-4f46-a859-678cb6b0c19f): created successfully
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d9aeee-3ebb-4214-946c-615664817479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Flow 'volume_create_manager' (4ee45a00-663a-472d-90cb-2f0924c609b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:50:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ca16a42d-d669-4ee8-a5d4-024251590460 tempest-TestStampPattern-1429662087 None] Created volume successfully.
Jul 07 03:50:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:50:13 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:15 devstack sudo[102140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:50:15 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:16 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.878s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:50:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:50:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:50:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Flow 'volume_create_manager' (b67298bc-e729-43a5-9cf6-14402c6c4f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea67a17-c0f9-4cf0-b620-e1eb7365e42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea67a17-c0f9-4cf0-b620-e1eb7365e42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-501713130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1cb90b-5203-4e67-905c-fe109b45ee8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7628a442525f403cbe74e1436290c0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:50:18Z,use_quota=True,user_id='12bfe613f23e4bc38a542f16ef3a1b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f4b3f-270c-4390-9c28-c2813b6a114d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894f4b3f-270c-4390-9c28-c2813b6a114d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc07836-4259-429a-a24e-34b3e2a50b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc07836-4259-429a-a24e-34b3e2a50b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'volume_name': 'volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f1c4950>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea567b62-2805-48ea-9c8b-ac10ee912904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea567b62-2805-48ea-9c8b-ac10ee912904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24cb471-49e9-4436-8aa5-0366968183ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f1c4950>}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Trying to clone 7c1cb90b-5203-4e67-905c-fe109b45ee8f from image bce35279-0f3f-4049-8975-1c6590eb177b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:50:18 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:50:18 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11f775-ce7c-4e7e-9626-d3252361b294]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:19 devstack sudo[102209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD
Jul 07 03:50:19 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:19 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b is fetched for user 12bfe613f23e4bc38a542f16ef3a1b03. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ae1d5-91e4-4690-af4f-88f450f5b179]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:19 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD
Jul 07 03:50:19 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:20 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD" returned: 0 in 0.736s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-501713130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1cb90b-5203-4e67-905c-fe109b45ee8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7628a442525f403cbe74e1436290c0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:50:18Z,use_quota=True,user_id='12bfe613f23e4bc38a542f16ef3a1b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Creating volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:50:20 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:50:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:20 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1073741824
Jul 07 03:50:20 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:21 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1073741824" returned: 0 in 0.905s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:21 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:21 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:22 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Attempting download of bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4fe851-f931-4962-9946-4b54e8980250]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:22 devstack sudo[102237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279
Jul 07 03:50:22 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:23 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:23 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279
Jul 07 03:50:23 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:24 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279" returned: 1 in 0.784s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bce35279-0f3f-4049-8975-1c6590eb177b__9_3t279' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbe5f6-a0d2-4e00-8e36-97f7ddf3e72e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:24 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD
Jul 07 03:50:24 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:24 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] bce35279-0f3f-4049-8975-1c6590eb177b was qcow2, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:50:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:24 devstack sudo[102251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:24 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:27 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 2.153s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bce35279-0f3f-4049-8975-1c6590eb177b_ja669u01devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:50:27 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Converted 112.00 MB image at 51.98 MB/s
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:27 devstack sudo[102262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1G
Jul 07 03:50:27 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:27 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f 1G" returned: 0 in 0.707s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd45b84a-1a66-4dd6-a106-214073268f03]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:27 devstack sudo[102267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:27 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:28 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:28 devstack sudo[102271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:28 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:29 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 1 in 0.768s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Downloaded image bce35279-0f3f-4049-8975-1c6590eb177b ((None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}])) to volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Temporary image bce35279-0f3f-4049-8975-1c6590eb177b for user 12bfe613f23e4bc38a542f16ef3a1b03 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Marking volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Copying metadata from image bce35279-0f3f-4049-8975-1c6590eb177b to 7c1cb90b-5203-4e67-905c-fe109b45ee8f. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Creating volume glance metadata for volume 7c1cb90b-5203-4e67-905c-fe109b45ee8f backed by image bce35279-0f3f-4049-8975-1c6590eb177b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24cb471-49e9-4436-8aa5-0366968183ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'volume_size': 1, 'image_id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bce35279-0f3f-4049-8975-1c6590eb177b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b92db006fd94ff8adfe78e6cd28fdc9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bce35279-0f3f-4049-8975-1c6590eb177b', 'created_at': datetime.datetime(2026, 7, 7, 1, 26, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 26, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bce35279-0f3f-4049-8975-1c6590eb177b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f1c4950>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c10e648-0f4a-4ca7-89ee-91731feeb115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:50:29 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Volume volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f (7c1cb90b-5203-4e67-905c-fe109b45ee8f): created successfully
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c10e648-0f4a-4ca7-89ee-91731feeb115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:50:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Flow 'volume_create_manager' (b67298bc-e729-43a5-9cf6-14402c6c4f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:50:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e2b15014-3ee1-46f5-9819-c1118c853ce2 tempest-TestShelveInstance-1664542973 None] Created volume successfully.
Jul 07 03:50:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb80a1-35aa-4f9a-9f66-4285174f6ed5]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:37 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:37 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:37 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:37 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:50:37 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:38 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 1 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:50:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.550s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9279695f-e083-40fe-b1c3-f78cda9a328b', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:50:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-85080395-fe90-4257-852b-bd83fa7d57b2 req-1c4cca81-1ffb-4fa9-8705-a95821d53f0c tempest-TestShelveInstance-1664542973 None] attachment_update completed successfully.
Jul 07 03:50:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=5,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:50:48 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=6 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:50:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:50:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:50:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[586bdf18-a734-490c-a069-3b1c53a23fed]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:50:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:50:49 devstack sudo[102811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:50:49 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:50:50 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root
Jul 07 03:50:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.839s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:50:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:50:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3632a6eb-8f33-4ea4-bfaf-2aafb4714a99', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:50:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-2873f100-b8d0-4fb4-94bf-96824f3296b8 req-5589625f-32c6-4ddd-aad7-3afe30c84ad5 tempest-TestStampPattern-1429662087 None] attachment_update completed successfully.
Jul 07 03:50:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-8717ba13-8882-4607-a1ad-eb18c2301721 req-7d4a9438-fa16-4d16-9cbd-65b08739ec91 tempest-TestStampPattern-1429662087 None] Terminate volume connection completed successfully.
Jul 07 03:50:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-8717ba13-8882-4607-a1ad-eb18c2301721 req-7d4a9438-fa16-4d16-9cbd-65b08739ec91 tempest-TestStampPattern-1429662087 None] Deleting attachment 3632a6eb-8f33-4ea4-bfaf-2aafb4714a99. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:51:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Creating offline snapshot 44bf9a9a-f113-4361-8d0f-036112962642 of volume df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:51:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebeda61e-9760-4eba-8ba5-fd9d1b2a0ee6]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:51:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:00 devstack sudo[102923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:51:00 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:01 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:01 devstack sudo[102952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 1G
Jul 07 03:51:01 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:01 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 1G" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:02 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:51:02 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:02 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.694s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:02 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 is being set with open permissions: ugo+rw
Jul 07 03:51:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:02 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:51:02 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:03 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:03 devstack sudo[102974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info
Jul 07 03:51:03 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:04 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info is being set with open permissions: ugo+rw
Jul 07 03:51:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:04 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info
Jul 07 03:51:04 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:04 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.info" returned: 0 in 0.655s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.301s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0fdbc71d-e2c6-424b-b610-15ee417e007b tempest-TestStampPattern-1429662087 None] Create snapshot completed successfully
Jul 07 03:51:14 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:51:14 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:51:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-d7cf50d2-04ac-4e9a-b593-ed629fbaefc8 req-a7c4b720-1b15-46fe-9091-62b61da4b4a2 tempest-TestShelveInstance-1664542973 None] Terminate volume connection completed successfully.
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-d7cf50d2-04ac-4e9a-b593-ed629fbaefc8 req-a7c4b720-1b15-46fe-9091-62b61da4b4a2 tempest-TestShelveInstance-1664542973 None] Deleting attachment 9279695f-e083-40fe-b1c3-f78cda9a328b. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Flow 'volume_create_manager' (7e884b70-1741-4215-aa5b-d9b4b14355a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed23bc00-5a47-4734-b5b2-2ba07799f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed23bc00-5a47-4734-b5b2-2ba07799f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-85493308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea5ada4-ce73-4191-9d04-e6b53fa16a32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ec18460e4c446b79ffd48b8972f459d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44bf9a9a-f113-4361-8d0f-036112962642,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:51:15Z,use_quota=True,user_id='94eb57358fa4469d83328da2f3fdf443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a521830-f599-45d3-9beb-40bd3d963af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:15 devstack sudo[103050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:51:15 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a521830-f599-45d3-9beb-40bd3d963af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7deae36-c2d8-4573-a4b5-1c6915408ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7deae36-c2d8-4573-a4b5-1c6915408ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ea5ada4-ce73-4191-9d04-e6b53fa16a32', 'volume_name': 'volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32', 'volume_size': 1, 'snapshot_id': '44bf9a9a-f113-4361-8d0f-036112962642'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9f1d25-863c-41ff-bf6c-c713c1ba019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9f1d25-863c-41ff-bf6c-c713c1ba019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24b6ba7-695c-4570-8a58-188460e1f347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Volume 5ea5ada4-ce73-4191-9d04-e6b53fa16a32: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32', 'volume_size': 1, 'snapshot_id': '44bf9a9a-f113-4361-8d0f-036112962642'}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Creating volume 5ea5ada4-ce73-4191-9d04-e6b53fa16a32 from snapshot 44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] snapshot: 44bf9a9a-f113-4361-8d0f-036112962642, volume: 5ea5ada4-ce73-4191-9d04-e6b53fa16a32,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06f777-0864-4092-9cf5-5f452f86ee99]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:51:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:15 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:51:15 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:16 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.716s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:51:16 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.881s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[57503985-6ce9-4c11-80c1-fea59bf09758]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:51:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:16 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:51:16 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:17 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.924s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:17 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:51:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:17 devstack sudo[103067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32
Jul 07 03:51:17 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:51:23 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" returned: 0 in 5.630s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583d23f-9976-48f6-a98d-cd2d7d24c59f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:51:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:23 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:51:23 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:24 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 1.059s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:51:24 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Converted 1024.00 MB image at 181.87 MB/s
Jul 07 03:51:24 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 is being set with open permissions: ugo+rw
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:24 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32
Jul 07 03:51:24 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:24 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" released by "_copy_volume_from_snapshot" :: held 9.368s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" released by "_create_volume_from_snapshot" :: held 9.400s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.417s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.341s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6110cb-d9bf-4b63-889a-f4abf5435977]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b24b6ba7-695c-4570-8a58-188460e1f347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32', 'volume_size': 1, 'snapshot_id': '44bf9a9a-f113-4361-8d0f-036112962642'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad995912-ba12-4d15-8688-1d47f04e192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:51:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Volume volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 (5ea5ada4-ce73-4191-9d04-e6b53fa16a32): created successfully
Jul 07 03:51:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad995912-ba12-4d15-8688-1d47f04e192d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:51:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Flow 'volume_create_manager' (7e884b70-1741-4215-aa5b-d9b4b14355a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:51:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-41ce8db5-3090-4dfa-b37b-ee61c8220cf9 tempest-TestStampPattern-1429662087 None] Created volume successfully.
Jul 07 03:51:25 devstack sudo[103114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:51:25 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:25 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.841s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:51:25 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:51:25 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:51:26 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Jul 07 03:51:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 1 in 0.774s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:51:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:51:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.671s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:51:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a160838-f15e-4285-8c59-070b713714fc', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:51:26 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-15cabf7a-3549-407f-81a5-a0a043505316 req-8f3434a0-28d0-442d-9742-9e4128837e62 tempest-TestShelveInstance-1664542973 None] attachment_update completed successfully.
Jul 07 03:51:36 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:51:36 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:51:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:51:58 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:52:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc38ccd-37f0-48a8-abc2-736bd081fbb6]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:13 devstack sudo[103748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32
Jul 07 03:52:13 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:14 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6', 'name': 'volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57ce3559-c2de-4574-a115-65a28ff9c9d6', 'enforce_multipath': True} {{(pid=86955) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 03:52:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-577b3825-ccf6-416a-b5a6-e4ba3285aa28 req-0bbd3faf-c48b-435f-a365-8656e1515bd8 tempest-TestStampPattern-1429662087 None] attachment_update completed successfully.
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:15 devstack sudo[103760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:52:15 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:16 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.694s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:52:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:52:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:52:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:52:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1a7fe87e-aa8a-4226-92ab-605552d382b3 tempest-TestShelveInstance-1664542973 None] Terminate volume connection completed successfully.
Jul 07 03:52:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1a7fe87e-aa8a-4226-92ab-605552d382b3 tempest-TestShelveInstance-1664542973 None] Deleting attachment 0a160838-f15e-4285-8c59-070b713714fc. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:52:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-1bb7c2c6-ba76-4f29-a068-d267ab655e0b req-861d0a2d-1d55-41a7-bcd8-47768c55bb06 tempest-TestStampPattern-1429662087 None] Terminate volume connection completed successfully.
Jul 07 03:52:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [req-1bb7c2c6-ba76-4f29-a068-d267ab655e0b req-861d0a2d-1d55-41a7-bcd8-47768c55bb06 tempest-TestStampPattern-1429662087 None] Deleting attachment 57ce3559-c2de-4574-a115-65a28ff9c9d6. {{(pid=86955) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Acquiring lock "cinder-7c1cb90b-5203-4e67-905c-fe109b45ee8f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "cinder-7c1cb90b-5203-4e67-905c-fe109b45ee8f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Acquiring lock "cinder-quobyte-7c1cb90b-5203-4e67-905c-fe109b45ee8f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "cinder-quobyte-7c1cb90b-5203-4e67-905c-fe109b45ee8f" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f52a2c-b44f-417a-8d49-9dc8d744ddd6]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:21 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:52:21 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:21 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.769s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:22 devstack sudo[103819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:52:22 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:22 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 1 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:22 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f
Jul 07 03:52:22 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:23 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7c1cb90b-5203-4e67-905c-fe109b45ee8f" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "cinder-quobyte-7c1cb90b-5203-4e67-905c-fe109b45ee8f" released by "delete_volume" :: held 2.272s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG cinder.quota [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Created reservations ['88ebcbe4-deaa-4768-9307-afae27a70791', 'f287673e-8fd5-4670-ba2d-3054e54565fe', 'd4bf84a3-9576-46a4-87f4-38088989e3b4', '30f16438-ac9b-46bf-8b5d-30d25beb57ec'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:23 devstack sudo[103829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:52:23 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:24 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.771s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:24 devstack cinder-volume[86955]: DEBUG cinder.manager [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:52:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Deleted volume successfully.
Jul 07 03:52:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [req-132a3b3c-3944-4666-8806-3d58068fa6f6 req-1e902a53-756f-45b4-9c4f-bf246aac4f26 tempest-TestShelveInstance-1664542973 None] Lock "cinder-7c1cb90b-5203-4e67-905c-fe109b45ee8f-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-5ea5ada4-ce73-4191-9d04-e6b53fa16a32-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "cinder-5ea5ada4-ce73-4191-9d04-e6b53fa16a32-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a400ab-663d-454b-b46d-5255e27e51a3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:30 devstack sudo[103862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32
Jul 07 03:52:30 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:31 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" returned: 0 in 0.845s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:31 devstack sudo[103868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32
Jul 07 03:52:31 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:31 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" returned: 0 in 0.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-5ea5ada4-ce73-4191-9d04-e6b53fa16a32" released by "delete_volume" :: held 1.552s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Created reservations ['fe901f23-0dae-4586-b0fc-a8338810dc1b', '148f2298-b805-466e-869e-f519ba219218', 'c9f78188-d4e8-45ff-98fd-a325adc471b0', 'e5fe5dbb-8699-4d1e-9cab-a216d3d6130c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:31 devstack sudo[103871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:52:31 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:32 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.727s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:52:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Deleted volume successfully.
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-694e862c-ced3-4d15-8ac4-746fd4fbc780 tempest-TestStampPattern-1429662087 None] Lock "cinder-5ea5ada4-ce73-4191-9d04-e6b53fa16a32-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-44bf9a9a-f113-4361-8d0f-036112962642-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-44bf9a9a-f113-4361-8d0f-036112962642-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Deleting offline snapshot 44bf9a9a-f113-4361-8d0f-036112962642 of volume df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] snapshot_file for this snap is: volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f775199f-90c4-45c2-847f-4784621bb8f7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:32 devstack sudo[103874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:52:32 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:33 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:52:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086af6e-3a83-49c8-a15c-8b10d71cd7ec]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:33 devstack sudo[103879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:52:33 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:34 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.784s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:34 devstack sudo[103884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:52:34 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:35 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.774s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:35 devstack sudo[103890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642
Jul 07 03:52:35 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:35 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f.44bf9a9a-f113-4361-8d0f-036112962642" returned: 0 in 0.660s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-44bf9a9a-f113-4361-8d0f-036112962642" released by "_delete_snapshot" :: held 3.124s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" released by "delete_snapshot" :: held 3.149s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Created reservations ['ea691dde-a297-4295-824a-8a7ed35c61ab', 'f03be7e0-4712-4542-a199-c7e54594fda6', 'ab6b39da-be38-4eff-8612-00fdcb548521', '382f5160-29de-4751-97ed-ee5fd8638e90'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:52:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Delete snapshot completed successfully.
Jul 07 03:52:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-899c2e7e-2914-4ede-a383-e60f70ce55e0 tempest-TestStampPattern-1429662087 None] Lock "cinder-44bf9a9a-f113-4361-8d0f-036112962642-delete_snapshot" released by "delete_snapshot" :: held 3.289s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Flow 'volume_create_manager' (ed617fc8-0d25-4e3c-b1e8-8d3bb218bc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff630b3-5ba5-4e73-8551-844c963ce465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fff630b3-5ba5-4e73-8551-844c963ce465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3c227-50a6-4a85-8e71-9e2e33d15141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d841cab85bda46b7b6a5493191eb1332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:38Z,use_quota=True,user_id='a1d8b4501ad748379bf9fa80d9817624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5e1bc22-a7f2-4d68-b62a-5e001878f79d),volume_type_id=e5e1bc22-a7f2-4d68-b62a-5e001878f79d)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b8e85d-3505-45fa-a3da-aa2ee64a6d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b8e85d-3505-45fa-a3da-aa2ee64a6d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc05497a-9fc5-40e4-a285-ed5299dae7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:37 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc05497a-9fc5-40e4-a285-ed5299dae7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32f3c227-50a6-4a85-8e71-9e2e33d15141', 'volume_name': 'volume-32f3c227-50a6-4a85-8e71-9e2e33d15141', 'volume_size': 1, 'image_id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b946be1eba61111ed9b634227618a36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd841cab85bda46b7b6a5493191eb1332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aea3a7c930ca936074fb02ba71e9c9438014fe517c77784bc600ec3144fd44fd037265c76f759ac601f6c96baa84dbfdc229a1b6b79377f6b2053e5f5e58a074', 'id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'created_at': datetime.datetime(2026, 7, 7, 1, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f12a300>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d447cc3-4e52-402d-959c-9c043cca9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d447cc3-4e52-402d-959c-9c043cca9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea854a4-fbd2-4008-aa49-49ec24a66063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:38 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Volume 32f3c227-50a6-4a85-8e71-9e2e33d15141: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32f3c227-50a6-4a85-8e71-9e2e33d15141', 'volume_size': 1, 'image_id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b946be1eba61111ed9b634227618a36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd841cab85bda46b7b6a5493191eb1332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aea3a7c930ca936074fb02ba71e9c9438014fe517c77784bc600ec3144fd44fd037265c76f759ac601f6c96baa84dbfdc229a1b6b79377f6b2053e5f5e58a074', 'id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'created_at': datetime.datetime(2026, 7, 7, 1, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f12a300>}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Trying to clone 32f3c227-50a6-4a85-8e71-9e2e33d15141 from image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:52:38 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4673e5-dae5-4c66-8651-175614b2e801]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:38 devstack sudo[103895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:38 devstack sudo[103895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:38 devstack sudo[103895]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:39 devstack sudo[103902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:39 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:39 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 1 in 0.801s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:39 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Temporary image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 is fetched for user a1d8b4501ad748379bf9fa80d9817624. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:52:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[123c5e55-b980-40fd-b4e2-fd2db7d588e9]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:40 devstack sudo[103924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:40 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:40 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:40 devstack sudo[103934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:40 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:41 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 1 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3c227-50a6-4a85-8e71-9e2e33d15141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d841cab85bda46b7b6a5493191eb1332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:38Z,use_quota=True,user_id='a1d8b4501ad748379bf9fa80d9817624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5e1bc22-a7f2-4d68-b62a-5e001878f79d),volume_type_id=e5e1bc22-a7f2-4d68-b62a-5e001878f79d)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Creating volume 32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:52:41 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:52:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:41 devstack sudo[103940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1073741824
Jul 07 03:52:41 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:42 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1073741824" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:42 devstack sudo[103946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:42 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:43 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 0 in 0.663s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Attempting download of 1c4e4760-16f5-4c9a-88d6-49c1d884d860 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}])) to volume 32f3c227-50a6-4a85-8e71-9e2e33d15141. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e12152-b747-441f-bafe-76fd8ad8132b]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:43 devstack sudo[103949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd
Jul 07 03:52:43 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:43 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd" returned: 0 in 0.739s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:44 devstack sudo[103953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd
Jul 07 03:52:44 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:44 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd" returned: 1 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1c4e4760-16f5-4c9a-88d6-49c1d884d860_jzok85fd' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d55ff-403a-4a1a-8ba9-94d2480db73a]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:44 devstack sudo[103993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:44 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-df9bb843-ba3e-4f46-a859-678cb6b0c19f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "cinder-df9bb843-ba3e-4f46-a859-678cb6b0c19f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Acquiring lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:45 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9e4746-88a1-4250-b408-4a9ec49bf9d1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:45 devstack sudo[103997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD
Jul 07 03:52:45 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:45 devstack sudo[103998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:52:45 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:46 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD" returned: 1 in 0.750s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] 1c4e4760-16f5-4c9a-88d6-49c1d884d860 was raw, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:46 devstack sudo[104007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:46 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:46 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:46 devstack sudo[104009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f
Jul 07 03:52:46 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:46 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1c4e4760-16f5-4c9a-88d6-49c1d884d860_hssqd_f1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:52:46 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 03:52:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:47 devstack sudo[104015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1G
Jul 07 03:52:47 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:47 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-df9bb843-ba3e-4f46-a859-678cb6b0c19f" returned: 0 in 0.682s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "cinder-quobyte-df9bb843-ba3e-4f46-a859-678cb6b0c19f" released by "delete_volume" :: held 1.558s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Created reservations ['bce1e52c-eb90-48e5-a3a7-4239e8c75bac', 'e45dffb6-75c8-4f74-86a1-11adafb05e28', 'bc91b9c8-28fd-46b6-973d-ed39d3f2e13a', 'b9042ad6-0a28-4d00-adca-44f310962743'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:47 devstack sudo[104017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:52:47 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:47 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 1G" returned: 0 in 0.732s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9cb0d-6a23-4fa9-ac67-6cfb42bfc9cb]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:47 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.684s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:52:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Deleted volume successfully.
Jul 07 03:52:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e624fe41-a3c5-4b35-b0cc-6593d1b1dcfe tempest-TestStampPattern-1429662087 None] Lock "cinder-df9bb843-ba3e-4f46-a859-678cb6b0c19f-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:47 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:47 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:48 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 0 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:48 devstack sudo[104027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:48 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:49 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 1 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Downloaded image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 ((None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}])) to volume 32f3c227-50a6-4a85-8e71-9e2e33d15141 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Temporary image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 for user a1d8b4501ad748379bf9fa80d9817624 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Marking volume 32f3c227-50a6-4a85-8e71-9e2e33d15141 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Copying metadata from image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 to 32f3c227-50a6-4a85-8e71-9e2e33d15141. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Creating volume glance metadata for volume 32f3c227-50a6-4a85-8e71-9e2e33d15141 backed by image 1c4e4760-16f5-4c9a-88d6-49c1d884d860 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4b946be1eba61111ed9b634227618a36', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea854a4-fbd2-4008-aa49-49ec24a66063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f3c227-50a6-4a85-8e71-9e2e33d15141', 'volume_size': 1, 'image_id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b946be1eba61111ed9b634227618a36', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd841cab85bda46b7b6a5493191eb1332', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aea3a7c930ca936074fb02ba71e9c9438014fe517c77784bc600ec3144fd44fd037265c76f759ac601f6c96baa84dbfdc229a1b6b79377f6b2053e5f5e58a074', 'id': '1c4e4760-16f5-4c9a-88d6-49c1d884d860', 'created_at': datetime.datetime(2026, 7, 7, 1, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1c4e4760-16f5-4c9a-88d6-49c1d884d860/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f12a300>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb577e5-47e2-4c44-8939-b5ccb156f28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Volume volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 (32f3c227-50a6-4a85-8e71-9e2e33d15141): created successfully
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb577e5-47e2-4c44-8939-b5ccb156f28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Flow 'volume_create_manager' (ed617fc8-0d25-4e3c-b1e8-8d3bb218bc48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:52:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bbc919cd-6f78-44e3-a540-799cdd9b1036 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Created volume successfully.
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Acquiring lock "cinder-32f3c227-50a6-4a85-8e71-9e2e33d15141-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "cinder-32f3c227-50a6-4a85-8e71-9e2e33d15141-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Acquiring lock "cinder-quobyte-32f3c227-50a6-4a85-8e71-9e2e33d15141" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "cinder-quobyte-32f3c227-50a6-4a85-8e71-9e2e33d15141" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d6b45e-8257-4b76-817a-6c47be8c05db]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:52:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:50 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:50 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:51 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 0 in 0.828s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:51 devstack sudo[104039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:51 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:52 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 1 in 0.838s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:52:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:52 devstack sudo[104044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141
Jul 07 03:52:52 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:52 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32f3c227-50a6-4a85-8e71-9e2e33d15141" returned: 0 in 0.662s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "cinder-quobyte-32f3c227-50a6-4a85-8e71-9e2e33d15141" released by "delete_volume" :: held 2.431s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:53 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:52:53 devstack cinder-volume[86955]: WARNING cinder.quota [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Created reservations ['55d5152e-e776-4c16-9170-42369b0c89d6', '77335319-b303-4cdc-80fb-daafad65cd0b', '6d13f26d-1cf0-452a-95e1-fbe74c92e394', '7fea7203-2cb4-409e-93b2-9b1af8800887'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:53 devstack sudo[104048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:52:53 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:53 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:52:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Deleted volume successfully.
Jul 07 03:52:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e3d72c56-2ce2-42bb-bb34-55fcfff683f4 tempest-VolumeAndVolumeTypeFromImageTest-1766027288 None] Lock "cinder-32f3c227-50a6-4a85-8e71-9e2e33d15141-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Flow 'volume_create_manager' (0d45db4d-3a8e-48e9-9e3f-8a0f1c1fefd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e2d30d-caee-4928-9927-788503988432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e2d30d-caee-4928-9927-788503988432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8c0fa1-dbb4-42de-825b-3cace7280eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0e8bc4ed0e4521bf84aed63ac552ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:58Z,use_quota=True,user_id='46672d197a9b4372b0ca6925dbe6cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c30ef4c-28e1-42d3-a474-cfc4dfcc3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c30ef4c-28e1-42d3-a474-cfc4dfcc3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a24815-b76d-4535-aa7e-ecc092cfbac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a24815-b76d-4535-aa7e-ecc092cfbac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b8c0fa1-dbb4-42de-825b-3cace7280eb9', 'volume_name': 'volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c5c73a-3b85-4ae0-b015-feaa084233a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c5c73a-3b85-4ae0-b015-feaa084233a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fafdc2-62ea-4590-a410-0fd1d69b4d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Volume 5b8c0fa1-dbb4-42de-825b-3cace7280eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9', 'volume_size': 1}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b8c0fa1-dbb4-42de-825b-3cace7280eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0e8bc4ed0e4521bf84aed63ac552ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:58Z,use_quota=True,user_id='46672d197a9b4372b0ca6925dbe6cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Creating volume 5b8c0fa1-dbb4-42de-825b-3cace7280eb9 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:52:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:52:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:58 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 1073741824
Jul 07 03:52:58 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (9164eeeb-2498-433c-89f1-ba1bff5d8ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee440d-0247-4e52-a24b-0dd3b31bea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cee440d-0247-4e52-a24b-0dd3b31bea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376706010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0290679-c060-4d08-9f4f-b8f744e8ce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:59Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecad7ac-6925-4513-92d5-56e991c1e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ecad7ac-6925-4513-92d5-56e991c1e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7c2f37-da08-418b-b272-1efd938123bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c7c2f37-da08-418b-b272-1efd938123bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0290679-c060-4d08-9f4f-b8f744e8ce48', 'volume_name': 'volume-c0290679-c060-4d08-9f4f-b8f744e8ce48', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920b7634-e4c9-4fee-9fe7-2a6b93e01e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920b7634-e4c9-4fee-9fe7-2a6b93e01e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa154663-c256-4877-bed2-78a15e570358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:52:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume c0290679-c060-4d08-9f4f-b8f744e8ce48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0290679-c060-4d08-9f4f-b8f744e8ce48', 'volume_size': 1}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:52:59 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 1073741824" returned: 0 in 0.849s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:52:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:52:59 devstack sudo[104065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9
Jul 07 03:52:59 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:00 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1376706010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0290679-c060-4d08-9f4f-b8f744e8ce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:52:59Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fafdc2-62ea-4590-a410-0fd1d69b4d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:00 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 1073741824
Jul 07 03:53:00 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263a36f5-f3ca-42ed-97b3-a4968476983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Volume volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 (5b8c0fa1-dbb4-42de-825b-3cace7280eb9): created successfully
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263a36f5-f3ca-42ed-97b3-a4968476983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Flow 'volume_create_manager' (0d45db4d-3a8e-48e9-9e3f-8a0f1c1fefd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-863463e9-b689-4f07-86cc-5c3dfda86dfc tempest-CinderUnicodeTest-1532769772 None] Created volume successfully.
Jul 07 03:53:01 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 1073741824" returned: 0 in 0.858s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:01 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48
Jul 07 03:53:01 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Flow 'volume_create_manager' (32b31cca-9bc0-4de5-b038-f9a9f0accc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc2331e-3135-4005-8a1b-a7ad40acb708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc2331e-3135-4005-8a1b-a7ad40acb708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1197439082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f2b5f4-1a8f-4726-9d25-da12ad538a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0e8bc4ed0e4521bf84aed63ac552ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:01Z,use_quota=True,user_id='46672d197a9b4372b0ca6925dbe6cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c11f67-22b9-46bc-ab62-094bf642f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91c11f67-22b9-46bc-ab62-094bf642f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794935c2-287e-4e74-9a03-2f4e7313a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794935c2-287e-4e74-9a03-2f4e7313a629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f2b5f4-1a8f-4726-9d25-da12ad538a97', 'volume_name': 'volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ddc7f-c1e4-4e2f-8b2e-1f6fa1951747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683ddc7f-c1e4-4e2f-8b2e-1f6fa1951747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1ff81-fbcc-4b72-b287-aaff1113f800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Volume c0f2b5f4-1a8f-4726-9d25-da12ad538a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97', 'volume_size': 1}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:01 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48" returned: 0 in 0.644s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1197439082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f2b5f4-1a8f-4726-9d25-da12ad538a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e0e8bc4ed0e4521bf84aed63ac552ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:01Z,use_quota=True,user_id='46672d197a9b4372b0ca6925dbe6cdf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Creating volume c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:01 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa154663-c256-4877-bed2-78a15e570358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0290679-c060-4d08-9f4f-b8f744e8ce48', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 1073741824
Jul 07 03:53:01 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14783612-4143-4d72-ac8f-b1fbab322165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 (c0290679-c060-4d08-9f4f-b8f744e8ce48): created successfully
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14783612-4143-4d72-ac8f-b1fbab322165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (9164eeeb-2498-433c-89f1-ba1bff5d8ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ba7305d-18a4-4fe7-ba0e-69bb57e027ac tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:02 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 1073741824" returned: 0 in 0.869s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:02 devstack sudo[104083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97
Jul 07 03:53:02 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:03 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" returned: 0 in 0.657s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.741s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1ff81-fbcc-4b72-b287-aaff1113f800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bd7fe3-408d-4c63-ad19-8fb4999e55ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating offline snapshot 0afaa7df-e2b6-4f45-b8d6-b345f262927b of volume c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:53:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Volume volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 (c0f2b5f4-1a8f-4726-9d25-da12ad538a97): created successfully
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bd7fe3-408d-4c63-ad19-8fb4999e55ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Flow 'volume_create_manager' (32b31cca-9bc0-4de5-b038-f9a9f0accc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3bc54-0962-4b57-8426-7d0d497ec86e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3999e657-d595-460e-8d5d-260912b176e9 tempest-CinderUnicodeTest-1532769772 None] Created volume successfully.
Jul 07 03:53:03 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48
Jul 07 03:53:03 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:04 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:04 devstack sudo[104093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b 1G
Jul 07 03:53:04 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:04 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b 1G" returned: 0 in 0.834s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:04 devstack sudo[104098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b
Jul 07 03:53:04 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:05 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b" returned: 0 in 0.723s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:05 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b is being set with open permissions: ugo+rw
Jul 07 03:53:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:05 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b
Jul 07 03:53:05 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:06 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b" returned: 0 in 0.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:06 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info
Jul 07 03:53:06 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:06 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info" returned: 0 in 0.640s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info is being set with open permissions: ugo+rw
Jul 07 03:53:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:07 devstack sudo[104109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info
Jul 07 03:53:07 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:07 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.info" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.154s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Creating offline snapshot 711a66c5-4e03-4523-b766-9d8683264909 of volume c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:53:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-83ef0859-6fcb-41f1-bb2c-b8cde1b2aa26 tempest-CreateVolumesFromSnapshotTest-118255724 None] Create snapshot completed successfully
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1eb568-8163-403d-975b-b1e362654c6c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:07 devstack sudo[104112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97
Jul 07 03:53:07 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:08 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" returned: 0 in 0.744s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:08 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 1G
Jul 07 03:53:08 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=46,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=58,cinder:UPDATE=48,cinder:INSERT=20,cinder:DELETE=1 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (2ce7d644-38c1-4fdb-9b83-beebf6f31d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3680941-c839-4340-9b27-5f7e3146f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3680941-c839-4340-9b27-5f7e3146f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772686661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d779f9-bbe4-402b-8e79-791e53e30932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:09Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fd890b-ea10-4991-a2db-8fbac0cb78f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fd890b-ea10-4991-a2db-8fbac0cb78f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80c3573-b9b3-40b0-96d4-0d8521367c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80c3573-b9b3-40b0-96d4-0d8521367c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d779f9-bbe4-402b-8e79-791e53e30932', 'volume_name': 'volume-f5d779f9-bbe4-402b-8e79-791e53e30932', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6c348-1c2f-4be8-a2f5-673cabd9e30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6c348-1c2f-4be8-a2f5-673cabd9e30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d864526b-cde0-4b17-ade9-b0b302ddc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume f5d779f9-bbe4-402b-8e79-791e53e30932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d779f9-bbe4-402b-8e79-791e53e30932', 'volume_size': 1}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:09 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 1G" returned: 0 in 0.851s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:09 devstack sudo[104124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909
Jul 07 03:53:09 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (11699071-f2d4-4131-b9d2-d3842ff5a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aeec31-8733-4065-add6-fc3c0b6f6c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04aeec31-8733-4065-add6-fc3c0b6f6c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842444095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a35b106-cd5a-45ef-87e5-597408454040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9477b60a-301a-4be0-80da-018ca95f0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9477b60a-301a-4be0-80da-018ca95f0194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af36b5fb-9e14-4b2e-9cfa-ff83354c58ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af36b5fb-9e14-4b2e-9cfa-ff83354c58ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a35b106-cd5a-45ef-87e5-597408454040', 'volume_name': 'volume-0a35b106-cd5a-45ef-87e5-597408454040', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ac0e8b-b4a2-44ee-b9da-e66e10437992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ac0e8b-b4a2-44ee-b9da-e66e10437992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f2b1b-3306-442c-8bea-f19326238411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume 0a35b106-cd5a-45ef-87e5-597408454040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a35b106-cd5a-45ef-87e5-597408454040', 'volume_size': 1}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (6755d9cd-a3e2-4180-851f-f25477d3a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a3f9a-4f2a-40ab-b117-467a4e47a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f49a3f9a-4f2a-40ab-b117-467a4e47a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112291475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3cddef-0a06-491e-992b-b56fc485d738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fd0a8a-b277-47b5-b080-42a11f80c250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fd0a8a-b277-47b5-b080-42a11f80c250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578c717-b8bb-4fa8-80a9-5ca5b81ebb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578c717-b8bb-4fa8-80a9-5ca5b81ebb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3cddef-0a06-491e-992b-b56fc485d738', 'volume_name': 'volume-fb3cddef-0a06-491e-992b-b56fc485d738', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900db589-954c-4399-9b82-4e87a5c8ee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900db589-954c-4399-9b82-4e87a5c8ee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06ce279-d7f2-4432-98d1-46d8d73373e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume fb3cddef-0a06-491e-992b-b56fc485d738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3cddef-0a06-491e-992b-b56fc485d738', 'volume_size': 1}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:10 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:10 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 is being set with open permissions: ugo+rw
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:10 devstack sudo[104130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909
Jul 07 03:53:10 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (92debcc7-0eb9-4cda-9e6e-5a398c415ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b90be00-f82e-4137-87d8-61065cf81e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b90be00-f82e-4137-87d8-61065cf81e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230857503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023b6530-1852-4e3d-bebc-bcef515407d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69474703-6491-461a-837f-abb3c84a87bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69474703-6491-461a-837f-abb3c84a87bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0680d32f-6a46-4dcc-9454-e5e65e20d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0680d32f-6a46-4dcc-9454-e5e65e20d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023b6530-1852-4e3d-bebc-bcef515407d8', 'volume_name': 'volume-023b6530-1852-4e3d-bebc-bcef515407d8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2288e9-cfbb-4813-b5b5-27608c7f74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c2288e9-cfbb-4813-b5b5-27608c7f74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc531dbd-bbfe-49ec-af4a-44f191ae1e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume 023b6530-1852-4e3d-bebc-bcef515407d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023b6530-1852-4e3d-bebc-bcef515407d8', 'volume_size': 1}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (8d58d742-b67e-473d-a858-aca804c568fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88923e2b-d483-4f4b-9d96-f636010e7aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88923e2b-d483-4f4b-9d96-f636010e7aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56224410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d70732e-31e1-4a74-abfa-67084bcb9d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:11Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c3b9d4-0916-4a10-b173-3062c28d48d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c3b9d4-0916-4a10-b173-3062c28d48d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a44e4-44ad-446b-a855-217894529e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94a44e4-44ad-446b-a855-217894529e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d70732e-31e1-4a74-abfa-67084bcb9d24', 'volume_name': 'volume-6d70732e-31e1-4a74-abfa-67084bcb9d24', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586fd4ab-1fff-4b06-b078-397e732552ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586fd4ab-1fff-4b06-b078-397e732552ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade02265-935a-4955-8e7d-81f7e5aebd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume 6d70732e-31e1-4a74-abfa-67084bcb9d24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d70732e-31e1-4a74-abfa-67084bcb9d24', 'volume_size': 1}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:10 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:10 devstack sudo[104133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info
Jul 07 03:53:10 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:11 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:11 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info is being set with open permissions: ugo+rw
Jul 07 03:53:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:11 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info
Jul 07 03:53:11 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:12 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.info" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.489s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.868s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1772686661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d779f9-bbe4-402b-8e79-791e53e30932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:09Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume f5d779f9-bbe4-402b-8e79-791e53e30932 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:12 devstack sudo[104139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 1073741824
Jul 07 03:53:12 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-46f52f87-3873-42e6-b64a-75d436a756cb tempest-CinderUnicodeTest-1532769772 None] Create snapshot completed successfully
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-711a66c5-4e03-4523-b766-9d8683264909-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-711a66c5-4e03-4523-b766-9d8683264909-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-quobyte-711a66c5-4e03-4523-b766-9d8683264909" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-711a66c5-4e03-4523-b766-9d8683264909" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Deleting offline snapshot 711a66c5-4e03-4523-b766-9d8683264909 of volume c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] snapshot_file for this snap is: volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929b0d6-4723-43ac-a756-10aee64b20eb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:13 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 1073741824" returned: 0 in 0.871s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:13 devstack sudo[104145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909
Jul 07 03:53:13 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:13 devstack sudo[104147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932
Jul 07 03:53:13 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:13 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ff2ab-f5ab-4cef-aa0e-ee35468d0189]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:13 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.065s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-842444095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a35b106-cd5a-45ef-87e5-597408454040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume 0a35b106-cd5a-45ef-87e5-597408454040 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:13 devstack sudo[104154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 1073741824
Jul 07 03:53:13 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d864526b-cde0-4b17-ade9-b0b302ddc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d779f9-bbe4-402b-8e79-791e53e30932', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ca8d2-e846-42bf-ab9f-2bd40f6f78cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-f5d779f9-bbe4-402b-8e79-791e53e30932 (f5d779f9-bbe4-402b-8e79-791e53e30932): created successfully
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ca8d2-e846-42bf-ab9f-2bd40f6f78cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (2ce7d644-38c1-4fdb-9b83-beebf6f31d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-100fc043-f2ca-497b-80ea-200cc8da3482 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:13 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97
Jul 07 03:53:13 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:14 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:14 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909
Jul 07 03:53:14 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:14 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 1073741824" returned: 0 in 0.846s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:14 devstack sudo[104166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040
Jul 07 03:53:14 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:15 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.302s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2112291475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3cddef-0a06-491e-992b-b56fc485d738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume fb3cddef-0a06-491e-992b-b56fc485d738 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:15 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 1073741824
Jul 07 03:53:15 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f2b1b-3306-442c-8bea-f19326238411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a35b106-cd5a-45ef-87e5-597408454040', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a697b-573a-4819-afee-ff03e1d8f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:15 devstack sudo[104174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:15 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:15 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-0a35b106-cd5a-45ef-87e5-597408454040 (0a35b106-cd5a-45ef-87e5-597408454040): created successfully
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (306a697b-573a-4819-afee-ff03e1d8f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:15 devstack sudo[104176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909
Jul 07 03:53:15 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (11699071-f2d4-4131-b9d2-d3842ff5a204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-674d0a51-9fe7-48e6-bfd4-241abc99c752 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:16 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:53:16 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97.711a66c5-4e03-4523-b766-9d8683264909" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-711a66c5-4e03-4523-b766-9d8683264909" released by "_delete_snapshot" :: held 3.279s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" released by "delete_snapshot" :: held 3.303s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:16 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 1073741824" returned: 0 in 0.910s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Created reservations ['bb9f21d3-20bc-4be5-b500-a47f51a1153e', '4364e865-ba4f-4f94-9319-0807f86fc05b', 'f9f55b59-d73c-4fe0-9f08-d9f6b797dd0f', '4b0f07e7-e3f5-4790-a7c5-79d1e0d328ea'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:16 devstack sudo[104184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738
Jul 07 03:53:16 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Delete snapshot completed successfully.
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bc7642e7-4dce-4089-b45c-812c8d7ed5bd tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-711a66c5-4e03-4523-b766-9d8683264909-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:16 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738" returned: 0 in 0.661s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.583s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230857503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023b6530-1852-4e3d-bebc-bcef515407d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:10Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume 023b6530-1852-4e3d-bebc-bcef515407d8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06ce279-d7f2-4432-98d1-46d8d73373e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3cddef-0a06-491e-992b-b56fc485d738', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:16 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 1073741824
Jul 07 03:53:16 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f44130d-8782-4858-b3a5-d23d57e953cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:17 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-fb3cddef-0a06-491e-992b-b56fc485d738 (fb3cddef-0a06-491e-992b-b56fc485d738): created successfully
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f44130d-8782-4858-b3a5-d23d57e953cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (6755d9cd-a3e2-4180-851f-f25477d3a154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:17 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-34bf83cc-f97d-4be1-9022-9baed894de8b tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-c0f2b5f4-1a8f-4726-9d25-da12ad538a97-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-c0f2b5f4-1a8f-4726-9d25-da12ad538a97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a10477b-00df-4d7e-a559-ec321d303d9b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:17 devstack sudo[104189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97
Jul 07 03:53:17 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:17 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 1073741824" returned: 0 in 0.845s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:17 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8
Jul 07 03:53:17 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:18 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" returned: 0 in 0.782s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:18 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97
Jul 07 03:53:18 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:18 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8" returned: 0 in 0.672s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.811s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-56224410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d70732e-31e1-4a74-abfa-67084bcb9d24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b4fdc6471e4e59adc2552ab7f3eea8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:11Z,use_quota=True,user_id='a951db5c84d74c10a1a571ee15d675f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Creating volume 6d70732e-31e1-4a74-abfa-67084bcb9d24 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:18 devstack sudo[104203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 1073741824
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc531dbd-bbfe-49ec-af4a-44f191ae1e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023b6530-1852-4e3d-bebc-bcef515407d8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:18 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e8b9d-7434-4df9-ad4d-2db5066cd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-023b6530-1852-4e3d-bebc-bcef515407d8 (023b6530-1852-4e3d-bebc-bcef515407d8): created successfully
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38e8b9d-7434-4df9-ad4d-2db5066cd149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (92debcc7-0eb9-4cda-9e6e-5a398c415ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d336799f-2a1b-4a69-92ed-dbd46c58aa7f tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:18 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-c0f2b5f4-1a8f-4726-9d25-da12ad538a97" released by "delete_volume" :: held 1.521s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Created reservations ['d1b5bcbf-9838-46be-b9b5-b7598f715664', '86771c66-cbdf-40e9-b5b8-b5f2f0f05381', 'a045f79a-f2dd-45d2-b527-33eae815dbd7', '0b38a67d-b088-4100-93fe-3700f5b90cc3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:18 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:18 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-5b8c0fa1-dbb4-42de-825b-3cace7280eb9-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-5b8c0fa1-dbb4-42de-825b-3cace7280eb9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "cinder-quobyte-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:19 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 1073741824" returned: 0 in 0.935s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[289d3ad6-2881-45ee-bab1-94ccb82b7121]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:19 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:19 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Deleted volume successfully.
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-dc427795-592f-4a1b-a2da-289ea40efb3e tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-c0f2b5f4-1a8f-4726-9d25-da12ad538a97-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:19 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24
Jul 07 03:53:19 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:19 devstack sudo[104214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9
Jul 07 03:53:19 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:20 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24" returned: 0 in 0.647s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade02265-935a-4955-8e7d-81f7e5aebd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d70732e-31e1-4a74-abfa-67084bcb9d24', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099dd0b3-6d04-4b04-b9e4-f83b6909ce7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Volume volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 (6d70732e-31e1-4a74-abfa-67084bcb9d24): created successfully
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (099dd0b3-6d04-4b04-b9e4-f83b6909ce7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Flow 'volume_create_manager' (8d58d742-b67e-473d-a858-aca804c568fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c3fd8ee7-baaf-4987-9d47-922e5e4df0b5 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created volume successfully.
Jul 07 03:53:20 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:20 devstack sudo[104222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9
Jul 07 03:53:20 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-6d70732e-31e1-4a74-abfa-67084bcb9d24-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-6d70732e-31e1-4a74-abfa-67084bcb9d24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-6d70732e-31e1-4a74-abfa-67084bcb9d24" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-6d70732e-31e1-4a74-abfa-67084bcb9d24" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2c0ac-e69b-47c8-b16b-d9bcda7d26ac]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:20 devstack sudo[104224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24
Jul 07 03:53:20 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:20 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-quobyte-5b8c0fa1-dbb4-42de-825b-3cace7280eb9" released by "delete_volume" :: held 1.475s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Created reservations ['31be58d3-9a68-4b42-867e-92cff697f5dd', '0d010d78-e348-47ca-9b01-6d61555374a5', '44783597-1fd0-41fe-be1d-22f07e8ac2ce', 'bcb71923-cfdb-4395-aa20-ee7b7352206d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:21 devstack sudo[104229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:21 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:21 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24" returned: 0 in 0.775s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:21 devstack sudo[104234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24
Jul 07 03:53:21 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:21 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.647s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Deleted volume successfully.
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-618af75f-7440-439d-af34-3d555a15845b tempest-CinderUnicodeTest-1532769772 None] Lock "cinder-5b8c0fa1-dbb4-42de-825b-3cace7280eb9-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:21 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6d70732e-31e1-4a74-abfa-67084bcb9d24" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-6d70732e-31e1-4a74-abfa-67084bcb9d24" released by "delete_volume" :: held 1.485s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['eb9c22b6-f8e2-4f40-9d93-f8fc9e8c86e9', '8267899c-c403-4bb9-bbea-af70ec9fa39f', 'a734b706-4624-4582-a9ee-75ab25e11d9e', 'd74d129e-24db-4a97-9d7a-d3c188103c87'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:22 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:22 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-023b6530-1852-4e3d-bebc-bcef515407d8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-023b6530-1852-4e3d-bebc-bcef515407d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-023b6530-1852-4e3d-bebc-bcef515407d8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-023b6530-1852-4e3d-bebc-bcef515407d8" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c397d4-44a8-4d22-9beb-09f28a994f79]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:22 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b4ed191d-eb20-4286-acf6-d6aa2738763a tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-6d70732e-31e1-4a74-abfa-67084bcb9d24-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:22 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8
Jul 07 03:53:22 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:23 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8" returned: 0 in 0.852s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:23 devstack sudo[104247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8
Jul 07 03:53:23 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:24 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-023b6530-1852-4e3d-bebc-bcef515407d8" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-023b6530-1852-4e3d-bebc-bcef515407d8" released by "delete_volume" :: held 1.545s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['2194620f-2174-49c1-8d3f-6abb917c9c5b', '453442fa-99a4-4b49-ba7d-4f29326fa9c4', 'f1bdc985-5a2a-4727-a7f0-a8f0c2907685', 'f89ee18c-e480-4468-bf04-f61f488a4432'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:24 devstack sudo[104250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:24 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-fb3cddef-0a06-491e-992b-b56fc485d738-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-fb3cddef-0a06-491e-992b-b56fc485d738-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-fb3cddef-0a06-491e-992b-b56fc485d738" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-fb3cddef-0a06-491e-992b-b56fc485d738" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[479ddd0c-295d-415a-8d08-3b63c7f9c8f4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:25 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.722s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-338a1ae3-8843-4ca0-a42c-f8ef1ab47787 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-023b6530-1852-4e3d-bebc-bcef515407d8-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:25 devstack sudo[104253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738
Jul 07 03:53:25 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:25 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:25 devstack sudo[104258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738
Jul 07 03:53:25 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:26 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fb3cddef-0a06-491e-992b-b56fc485d738" returned: 0 in 0.673s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-fb3cddef-0a06-491e-992b-b56fc485d738" released by "delete_volume" :: held 1.530s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['8b74ee7e-520c-4780-a88d-7d36a6383e96', '17b2529a-2add-4f89-9fcb-d617e8d2cc3b', 'ec475ed6-41c5-461b-aeb2-7175ebd63438', '4eb9335c-92a3-4d75-a10d-79486bce96fa'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:26 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:26 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-0a35b106-cd5a-45ef-87e5-597408454040-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-0a35b106-cd5a-45ef-87e5-597408454040-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-0a35b106-cd5a-45ef-87e5-597408454040" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-0a35b106-cd5a-45ef-87e5-597408454040" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da54396-c00b-4461-89a8-7324b00f9188]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:27 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.692s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-61d1f9e9-221c-4b27-8715-dc197aa8812d tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-fb3cddef-0a06-491e-992b-b56fc485d738-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:27 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040
Jul 07 03:53:27 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:28 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:28 devstack sudo[104269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040
Jul 07 03:53:28 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:28 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a35b106-cd5a-45ef-87e5-597408454040" returned: 0 in 0.624s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-0a35b106-cd5a-45ef-87e5-597408454040" released by "delete_volume" :: held 1.458s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['877b70c7-8d6a-40e9-857d-cd4e1d128d67', 'a969dba5-c1d3-49fc-957a-37e1db7c8f06', '954242c0-5ef6-47a9-aaef-e0a5fef09410', '9525ff67-a3c6-4a7a-bcc1-4ab09e683c0a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:28 devstack sudo[104272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:28 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:29 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0cc85f7-4bfd-4473-b245-a55f79fa96c8 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-0a35b106-cd5a-45ef-87e5-597408454040-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-f5d779f9-bbe4-402b-8e79-791e53e30932-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-f5d779f9-bbe4-402b-8e79-791e53e30932-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-f5d779f9-bbe4-402b-8e79-791e53e30932" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-f5d779f9-bbe4-402b-8e79-791e53e30932" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d3a2b7-f851-4e78-8cda-619a77645e75]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (ce813e51-4295-47dc-adaa-0af069a9be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:29 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc1eafc-d1c3-4a9a-bc25-ccc7de249b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc1eafc-d1c3-4a9a-bc25-ccc7de249b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591387685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49641bf-32a2-4f03-a7bb-2bef0b9fdde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:30Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83325d3-0f5f-4009-80e4-e8bf69498d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83325d3-0f5f-4009-80e4-e8bf69498d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23dd9ec-e98e-47d7-968c-86104821eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d23dd9ec-e98e-47d7-968c-86104821eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49641bf-32a2-4f03-a7bb-2bef0b9fdde8', 'volume_name': 'volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717a612a-0bda-49ab-865e-4bc4da8bca7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717a612a-0bda-49ab-865e-4bc4da8bca7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45990f0a-c96e-47b9-979b-090b1b55069d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Volume d49641bf-32a2-4f03-a7bb-2bef0b9fdde8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8', 'volume_size': 1}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-591387685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49641bf-32a2-4f03-a7bb-2bef0b9fdde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:30Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Creating volume d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:30 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:30 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:30 devstack sudo[104278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 1073741824
Jul 07 03:53:30 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:30 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932" returned: 0 in 0.783s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:30 devstack sudo[104287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932
Jul 07 03:53:30 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:30 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 1073741824" returned: 0 in 0.818s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:30 devstack sudo[104290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8
Jul 07 03:53:30 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:31 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f5d779f9-bbe4-402b-8e79-791e53e30932" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-f5d779f9-bbe4-402b-8e79-791e53e30932" released by "delete_volume" :: held 1.506s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['6c80cbf5-434f-4701-830c-3150ad6741e9', '02fbdbb6-4cb2-4291-8f26-68b8e96148b2', 'ec76991a-b776-436a-a943-e46aa7c20c3a', 'b49d5e2d-5c5f-4d7d-9275-1d0833053fbb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:31 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:31 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:31 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45990f0a-c96e-47b9-979b-090b1b55069d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c955ba3a-eda7-46f8-95ce-d2d427921d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Volume volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 (d49641bf-32a2-4f03-a7bb-2bef0b9fdde8): created successfully
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c955ba3a-eda7-46f8-95ce-d2d427921d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (ce813e51-4295-47dc-adaa-0af069a9be06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-af9da943-5e99-4534-967d-9d1d997041fa tempest-ProjectReaderTests-1294463021 None] Created volume successfully.
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-0afaa7df-e2b6-4f45-b8d6-b345f262927b-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-0afaa7df-e2b6-4f45-b8d6-b345f262927b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-0afaa7df-e2b6-4f45-b8d6-b345f262927b" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-0afaa7df-e2b6-4f45-b8d6-b345f262927b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleting offline snapshot 0afaa7df-e2b6-4f45-b8d6-b345f262927b of volume c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] snapshot_file for this snap is: volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a3b63-9edf-4e6b-9d5b-3e2a959b0387]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "cinder-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-quobyte-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:32 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:32 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b
Jul 07 03:53:32 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb149ae-f2a2-4a19-9b5e-6d21a32bc452]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e04b6853-e9e5-43fe-a634-9177139acb3e tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-f5d779f9-bbe4-402b-8e79-791e53e30932-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:32 devstack sudo[104299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8
Jul 07 03:53:32 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:32 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0290679-c060-4d08-9f4f-b8f744e8ce48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f33530c-8604-4fbd-8b37-add8e34d6a31]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:33 devstack sudo[104306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48
Jul 07 03:53:33 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:33 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" returned: 0 in 0.778s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:33 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8
Jul 07 03:53:33 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:33 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:33 devstack sudo[104315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b
Jul 07 03:53:33 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:33 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8" released by "delete_volume" :: held 1.492s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Created reservations ['030aeb9f-9a60-4c21-a7fc-b062c2eb45bc', '8c9edb07-3b42-4954-9b3e-2d91ed8b288e', '59af3bd5-cd48-46b6-b4d3-e21d1eb1d508', '6d1c5859-8874-4873-8a94-549bb1b629e1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:33 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:33 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:34 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b" returned: 0 in 0.762s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:34 devstack sudo[104323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b
Jul 07 03:53:34 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:34 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Deleted volume successfully.
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-04438b9a-083c-44c2-b181-d7e5ff5d707a tempest-ProjectReaderTests-1294463021 None] Lock "cinder-d49641bf-32a2-4f03-a7bb-2bef0b9fdde8-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (23ac13d6-8de4-4ef2-94dd-450b71a22733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7957ec2a-9e2d-4d62-b64b-a4347315b4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7957ec2a-9e2d-4d62-b64b-a4347315b4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668386896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6149d9e-b216-44a0-9e29-9d33a7673e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:35Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49fe92b-73d2-43e8-9bbf-5077b32b02aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d49fe92b-73d2-43e8-9bbf-5077b32b02aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e41996b-eda3-49ef-b120-85a11e58a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e41996b-eda3-49ef-b120-85a11e58a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6149d9e-b216-44a0-9e29-9d33a7673e67', 'volume_name': 'volume-f6149d9e-b216-44a0-9e29-9d33a7673e67', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25537c6-b841-461d-8a6f-a40ecabb0d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c25537c6-b841-461d-8a6f-a40ecabb0d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042b5133-d380-4a31-be1f-4e66abca6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Volume f6149d9e-b216-44a0-9e29-9d33a7673e67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6149d9e-b216-44a0-9e29-9d33a7673e67', 'volume_size': 1}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1668386896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6149d9e-b216-44a0-9e29-9d33a7673e67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:35Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Creating volume f6149d9e-b216-44a0-9e29-9d33a7673e67 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:34 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:35 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 1073741824
Jul 07 03:53:35 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:35 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48.0afaa7df-e2b6-4f45-b8d6-b345f262927b" returned: 0 in 0.710s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-0afaa7df-e2b6-4f45-b8d6-b345f262927b" released by "_delete_snapshot" :: held 3.147s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" released by "delete_snapshot" :: held 3.175s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['8eef06f0-3cb2-45d6-8df0-1a2b3acce34b', 'e30c81eb-f689-4a23-ad30-be8270739a8c', '96f4405d-cc72-4953-95d6-bdcb4f788a7c', 'c7640855-c330-4993-9a5a-79a68ca7638d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:35 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Delete snapshot completed successfully.
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f4618e75-2798-444d-a3cd-00b0ac05f038 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-0afaa7df-e2b6-4f45-b8d6-b345f262927b-delete_snapshot" released by "delete_snapshot" :: held 3.324s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:35 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 1073741824" returned: 0 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:35 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67
Jul 07 03:53:35 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-c0290679-c060-4d08-9f4f-b8f744e8ce48-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-c0290679-c060-4d08-9f4f-b8f744e8ce48-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fe08f-bd75-4888-998e-f0c4e323fbf1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:36 devstack sudo[104335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48
Jul 07 03:53:36 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:36 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042b5133-d380-4a31-be1f-4e66abca6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6149d9e-b216-44a0-9e29-9d33a7673e67', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2a5320-3322-4c08-a63c-a17e829b6fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Volume volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 (f6149d9e-b216-44a0-9e29-9d33a7673e67): created successfully
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2a5320-3322-4c08-a63c-a17e829b6fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (23ac13d6-8de4-4ef2-94dd-450b71a22733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91db5bb0-07ae-4ae0-9161-21b7b981c5b8 tempest-ProjectReaderTests-1294463021 None] Created volume successfully.
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-f6149d9e-b216-44a0-9e29-9d33a7673e67-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "cinder-f6149d9e-b216-44a0-9e29-9d33a7673e67-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-quobyte-f6149d9e-b216-44a0-9e29-9d33a7673e67" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-f6149d9e-b216-44a0-9e29-9d33a7673e67" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7003cb19-9bb6-45a1-80a8-b7eef2bc1445]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:37 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:37 devstack sudo[104342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48
Jul 07 03:53:37 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:37 devstack sudo[104341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67
Jul 07 03:53:37 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:37 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c0290679-c060-4d08-9f4f-b8f744e8ce48" returned: 0 in 0.626s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-quobyte-c0290679-c060-4d08-9f4f-b8f744e8ce48" released by "delete_volume" :: held 1.471s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:37 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Created reservations ['ef961214-bebc-4b42-bcf8-1a5f423e3889', '11e4f91b-a9de-4cca-a03e-c20d642c33db', '05bd34ad-b242-4aca-b676-146de72eaf49', '6a67ac4a-9e6f-4840-98be-b72cedcff2e4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:37 devstack sudo[104349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67
Jul 07 03:53:37 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:37 devstack sudo[104351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:37 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:38 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f6149d9e-b216-44a0-9e29-9d33a7673e67" returned: 0 in 0.660s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-f6149d9e-b216-44a0-9e29-9d33a7673e67" released by "delete_volume" :: held 1.451s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:38 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Created reservations ['70435126-92d5-433d-9ec5-7588d52cc6df', 'd931ba01-889c-4104-8fb3-ec775cec7c99', '470f5360-a9d4-424e-9cc0-67f2dfb6bc72', '5ffbf60b-68c1-4663-aec2-699c0751e4af'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Deleted volume successfully.
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-46823399-b411-4e8b-8e7f-76bf324048e4 tempest-CreateVolumesFromSnapshotTest-118255724 None] Lock "cinder-c0290679-c060-4d08-9f4f-b8f744e8ce48-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:38 devstack sudo[104355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:38 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:39 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.683s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Deleted volume successfully.
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c0b1dee1-ddef-4d7b-8f3c-9d715d61a3c2 tempest-ProjectReaderTests-1294463021 None] Lock "cinder-f6149d9e-b216-44a0-9e29-9d33a7673e67-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (1d2d37b9-971f-4121-813b-93129880e3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0631468-161f-4bb2-a2ac-3638b8f11e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0631468-161f-4bb2-a2ac-3638b8f11e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997963590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68de82d0-a15f-4a6f-aa09-8192ed07f34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:40Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c53a5f-89a1-4322-8059-6af0a4b7415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c53a5f-89a1-4322-8059-6af0a4b7415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ecb63-3b1d-4c58-ae92-5a0ef0ad9ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ecb63-3b1d-4c58-ae92-5a0ef0ad9ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68de82d0-a15f-4a6f-aa09-8192ed07f34c', 'volume_name': 'volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f82369e-5c43-4eb5-8864-0693eef38ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f82369e-5c43-4eb5-8864-0693eef38ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d801dd-7809-42c8-8cf5-caff99a0acbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Volume 68de82d0-a15f-4a6f-aa09-8192ed07f34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c', 'volume_size': 1}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997963590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68de82d0-a15f-4a6f-aa09-8192ed07f34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:40Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Creating volume 68de82d0-a15f-4a6f-aa09-8192ed07f34c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:39 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:39 devstack sudo[104359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c 1073741824
Jul 07 03:53:39 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:40 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c 1073741824" returned: 0 in 0.897s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:40 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c
Jul 07 03:53:40 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:41 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d801dd-7809-42c8-8cf5-caff99a0acbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defd50d0-d5eb-4de4-968a-67aae8662571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Volume volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c (68de82d0-a15f-4a6f-aa09-8192ed07f34c): created successfully
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (defd50d0-d5eb-4de4-968a-67aae8662571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (1d2d37b9-971f-4121-813b-93129880e3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-42dd9f83-1b79-4b1b-8c57-5d3414a0786d tempest-ProjectReaderTests-1294463021 None] Created volume successfully.
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-68de82d0-a15f-4a6f-aa09-8192ed07f34c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "cinder-68de82d0-a15f-4a6f-aa09-8192ed07f34c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-quobyte-68de82d0-a15f-4a6f-aa09-8192ed07f34c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-68de82d0-a15f-4a6f-aa09-8192ed07f34c" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[864634e9-c45c-4220-808a-b63776056763]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Flow 'volume_create_manager' (eccbc276-1252-4b92-aacb-15bc003a8542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb5abb1-2a64-4d68-a5c7-a59040059644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb5abb1-2a64-4d68-a5c7-a59040059644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171792782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd1d3a1-5454-4b6f-9259-25fceec80c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecdbf2b8cd24e1cb9fb2234e5206049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:42Z,use_quota=True,user_id='489d271a4681475fb59f2c7dce7d3038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc082b9-9aa0-4043-90ab-a7e088a7ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc082b9-9aa0-4043-90ab-a7e088a7ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37412faf-dae4-4a57-b107-405c3bc8ed67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37412faf-dae4-4a57-b107-405c3bc8ed67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd1d3a1-5454-4b6f-9259-25fceec80c57', 'volume_name': 'volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4480fcb4-fc54-4f9a-8189-f0461cbc8a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4480fcb4-fc54-4f9a-8189-f0461cbc8a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae3a765-6f17-4235-af06-e96ff6742b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Volume 9fd1d3a1-5454-4b6f-9259-25fceec80c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57', 'volume_size': 1}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-171792782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd1d3a1-5454-4b6f-9259-25fceec80c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecdbf2b8cd24e1cb9fb2234e5206049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:42Z,use_quota=True,user_id='489d271a4681475fb59f2c7dce7d3038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Creating volume 9fd1d3a1-5454-4b6f-9259-25fceec80c57 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:42 devstack sudo[104368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c
Jul 07 03:53:42 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:42 devstack sudo[104369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 1073741824
Jul 07 03:53:42 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:42 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c" returned: 0 in 0.768s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:42 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c
Jul 07 03:53:42 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:42 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 1073741824" returned: 0 in 0.792s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:42 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57
Jul 07 03:53:42 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:43 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-68de82d0-a15f-4a6f-aa09-8192ed07f34c" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-68de82d0-a15f-4a6f-aa09-8192ed07f34c" released by "delete_volume" :: held 1.456s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Created reservations ['4c69a68e-0634-45db-b61f-78fbe6ef75f6', '0ca7bd06-9097-42c9-b162-bf771e0e372a', '2046a954-9917-456d-9e2b-6ce695fe7cde', '271c8f65-742e-416d-8542-14857a8fb58a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:43 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:43 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:43 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae3a765-6f17-4235-af06-e96ff6742b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff30c6c-f547-4798-8c72-56383ec4a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Volume volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 (9fd1d3a1-5454-4b6f-9259-25fceec80c57): created successfully
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff30c6c-f547-4798-8c72-56383ec4a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Flow 'volume_create_manager' (eccbc276-1252-4b92-aacb-15bc003a8542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-69164027-19d0-4307-b27c-5e627ad2651a tempest-ProjectReaderTests-77734309 None] Created volume successfully.
Jul 07 03:53:44 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Deleted volume successfully.
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Acquiring lock "cinder-9fd1d3a1-5454-4b6f-9259-25fceec80c57-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d0e9db79-8b22-44cd-ac62-28f7896084aa tempest-ProjectReaderTests-1294463021 None] Lock "cinder-68de82d0-a15f-4a6f-aa09-8192ed07f34c-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "cinder-9fd1d3a1-5454-4b6f-9259-25fceec80c57-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Acquiring lock "cinder-quobyte-9fd1d3a1-5454-4b6f-9259-25fceec80c57" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "cinder-quobyte-9fd1d3a1-5454-4b6f-9259-25fceec80c57" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ecb7c-626b-4846-97c1-617f2fde7bfb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:44 devstack sudo[104388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57
Jul 07 03:53:44 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (7163e905-a53f-4d66-9dda-630e7429aa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf745f3-b237-4a88-8907-cecf0293afc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf745f3-b237-4a88-8907-cecf0293afc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503788252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb17bf-cc7a-425d-9794-72529c39c23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:45Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba459233-f052-4b5d-b4c1-f2beb066951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba459233-f052-4b5d-b4c1-f2beb066951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ff7433-78c0-42da-a2d4-fbe30e2cc199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8ff7433-78c0-42da-a2d4-fbe30e2cc199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98eb17bf-cc7a-425d-9794-72529c39c23f', 'volume_name': 'volume-98eb17bf-cc7a-425d-9794-72529c39c23f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e43ee2-38ff-443d-9d6a-b5721edab190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e43ee2-38ff-443d-9d6a-b5721edab190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0178567-cc7c-458f-be6f-979b8c1c8a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Volume 98eb17bf-cc7a-425d-9794-72529c39c23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98eb17bf-cc7a-425d-9794-72529c39c23f', 'volume_size': 1}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1503788252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98eb17bf-cc7a-425d-9794-72529c39c23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8a33b6ddc9424aaf4367e73a03bde4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:45Z,use_quota=True,user_id='5b39a9c4052545faaa2fd423ad45ab39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Creating volume 98eb17bf-cc7a-425d-9794-72529c39c23f {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:44 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f 1073741824
Jul 07 03:53:44 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:45 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:45 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57
Jul 07 03:53:45 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:45 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f 1073741824" returned: 0 in 0.857s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:45 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f
Jul 07 03:53:45 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:45 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9fd1d3a1-5454-4b6f-9259-25fceec80c57" returned: 0 in 0.658s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "cinder-quobyte-9fd1d3a1-5454-4b6f-9259-25fceec80c57" released by "delete_volume" :: held 1.494s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Created reservations ['3e6eea63-c480-4aa3-9303-030ddf074065', '97b375d1-b7fa-411d-ac17-80878a80bfde', '94a44ab2-a2cd-4840-a6c0-0b9270df953f', '81a24040-6de4-440a-add9-03151b586c08'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:45 devstack sudo[104441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:45 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:46 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0178567-cc7c-458f-be6f-979b8c1c8a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98eb17bf-cc7a-425d-9794-72529c39c23f', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e98655-e75d-45d6-987a-a50ca0117869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Volume volume-98eb17bf-cc7a-425d-9794-72529c39c23f (98eb17bf-cc7a-425d-9794-72529c39c23f): created successfully
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e98655-e75d-45d6-987a-a50ca0117869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Flow 'volume_create_manager' (7163e905-a53f-4d66-9dda-630e7429aa83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-228232d5-b3e2-4b78-b757-9880e51a29e6 tempest-ProjectReaderTests-1294463021 None] Created volume successfully.
Jul 07 03:53:46 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Deleted volume successfully.
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-de03d363-7fc6-45c3-847a-e0d4288a0fb5 tempest-ProjectReaderTests-77734309 None] Lock "cinder-9fd1d3a1-5454-4b6f-9259-25fceec80c57-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-98eb17bf-cc7a-425d-9794-72529c39c23f-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "cinder-98eb17bf-cc7a-425d-9794-72529c39c23f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Acquiring lock "cinder-quobyte-98eb17bf-cc7a-425d-9794-72529c39c23f" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-98eb17bf-cc7a-425d-9794-72529c39c23f" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1310a29-04ae-468c-a212-e3addc54e720]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Flow 'volume_create_manager' (ded478b9-5b21-4628-bcec-554810b8eb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007b9c3-3e5c-4642-a701-bc4abf9894e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b007b9c3-3e5c-4642-a701-bc4abf9894e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062053846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c627d9d3-8035-4a64-ba63-7809486d2924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecdbf2b8cd24e1cb9fb2234e5206049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:47Z,use_quota=True,user_id='489d271a4681475fb59f2c7dce7d3038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00bf43-0b4c-456d-9b3f-8840718aadff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b00bf43-0b4c-456d-9b3f-8840718aadff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b66a5e2-e4e6-4bfe-8c82-ba9e0fcf99b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b66a5e2-e4e6-4bfe-8c82-ba9e0fcf99b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c627d9d3-8035-4a64-ba63-7809486d2924', 'volume_name': 'volume-c627d9d3-8035-4a64-ba63-7809486d2924', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:47 devstack sudo[104445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f
Jul 07 03:53:47 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59527e2f-3627-4c63-a670-c9add9259576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59527e2f-3627-4c63-a670-c9add9259576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009600c-972a-430a-b763-36a4de2d25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Volume c627d9d3-8035-4a64-ba63-7809486d2924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c627d9d3-8035-4a64-ba63-7809486d2924', 'volume_size': 1}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062053846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c627d9d3-8035-4a64-ba63-7809486d2924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ecdbf2b8cd24e1cb9fb2234e5206049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:53:47Z,use_quota=True,user_id='489d271a4681475fb59f2c7dce7d3038',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Creating volume c627d9d3-8035-4a64-ba63-7809486d2924 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:53:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:47 devstack sudo[104447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 1073741824
Jul 07 03:53:47 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:47 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f" returned: 0 in 0.785s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:47 devstack sudo[104455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f
Jul 07 03:53:47 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:47 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 1073741824" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:47 devstack sudo[104458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924
Jul 07 03:53:47 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:48 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-98eb17bf-cc7a-425d-9794-72529c39c23f" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "cinder-quobyte-98eb17bf-cc7a-425d-9794-72529c39c23f" released by "delete_volume" :: held 1.513s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Created reservations ['4afca465-403a-4a87-a738-10ab05674d55', '3765d6aa-e31b-4abe-b216-6ccd68e5b7b3', 'a2f36673-a4b7-4737-a472-6694a9f005ff', 'f300f9ee-6edc-4463-9e8e-f44b1e5f1764'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:48 devstack sudo[104461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:48 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:48 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d009600c-972a-430a-b763-36a4de2d25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c627d9d3-8035-4a64-ba63-7809486d2924', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae90c0-d54d-4858-87e5-aeea6160c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:53:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Volume volume-c627d9d3-8035-4a64-ba63-7809486d2924 (c627d9d3-8035-4a64-ba63-7809486d2924): created successfully
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ae90c0-d54d-4858-87e5-aeea6160c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:53:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Flow 'volume_create_manager' (ded478b9-5b21-4628-bcec-554810b8eb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:53:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d66dfc16-6e5a-48dc-b58f-0c8851ab066b tempest-ProjectReaderTests-77734309 None] Created volume successfully.
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Acquiring lock "cinder-c627d9d3-8035-4a64-ba63-7809486d2924-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "cinder-c627d9d3-8035-4a64-ba63-7809486d2924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:49 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Acquiring lock "cinder-quobyte-c627d9d3-8035-4a64-ba63-7809486d2924" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:53:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Deleted volume successfully.
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "cinder-quobyte-c627d9d3-8035-4a64-ba63-7809486d2924" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-44b9a507-4711-4580-a126-edff086d5ccf tempest-ProjectReaderTests-1294463021 None] Lock "cinder-98eb17bf-cc7a-425d-9794-72529c39c23f-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef73d2-a9e8-4155-bad7-9c6b3ec9473a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:53:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:49 devstack sudo[104465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924
Jul 07 03:53:49 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:50 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:50 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924
Jul 07 03:53:50 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:50 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c627d9d3-8035-4a64-ba63-7809486d2924" returned: 0 in 0.688s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "cinder-quobyte-c627d9d3-8035-4a64-ba63-7809486d2924" released by "delete_volume" :: held 1.537s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Created reservations ['efa28a47-44e1-42b3-9834-c44aa77d2b3a', '380333f5-9311-4a18-af4c-933a45eac80c', 'a89a0026-f070-41ca-8c61-c10793bf7167', 'a0676493-1550-4d6e-8d9f-ffb81fff7cc1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:53:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:53:50 devstack sudo[104474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:53:50 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:53:51 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root
Jul 07 03:53:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:53:51 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:53:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Deleted volume successfully.
Jul 07 03:53:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-07c36e65-fb59-4783-98a7-7d2aa20a27b8 tempest-ProjectReaderTests-77734309 None] Lock "cinder-c627d9d3-8035-4a64-ba63-7809486d2924-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:00 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=102,cinder:UPDATE=163,cinder:INSERT=40,cinder:DELETE=14 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:54:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=109,cinder:UPDATE=151,cinder:INSERT=36,cinder:DELETE=12 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Flow 'volume_create_manager' (fa42a075-c274-4305-b0db-44ab3561ff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54522534-c0f4-4d5b-825c-368b4329b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54522534-c0f4-4d5b-825c-368b4329b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccd7a93-e947-4754-b4dd-61e9f8ec2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377308db38eb4c55aa413ce1f52901f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:03Z,use_quota=True,user_id='ac9e51a57fc5483cb9eaffbb7e68c029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f05b7-0fc3-4857-af99-688e858e18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f05b7-0fc3-4857-af99-688e858e18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b65ca-b4d1-4f4b-b48a-097ecb767b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b65ca-b4d1-4f4b-b48a-097ecb767b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccd7a93-e947-4754-b4dd-61e9f8ec2357', 'volume_name': 'volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a81bf3-964a-4b83-bfdc-c4496d98d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a81bf3-964a-4b83-bfdc-c4496d98d72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b981fc4-b496-41b9-bbf3-e71556fe4a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Volume eccd7a93-e947-4754-b4dd-61e9f8ec2357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357', 'volume_size': 1}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccd7a93-e947-4754-b4dd-61e9f8ec2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377308db38eb4c55aa413ce1f52901f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:03Z,use_quota=True,user_id='ac9e51a57fc5483cb9eaffbb7e68c029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Creating volume eccd7a93-e947-4754-b4dd-61e9f8ec2357 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:03 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:03 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 1073741824
Jul 07 03:54:03 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (6c72cf13-6681-468e-a745-769e67a02e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfccd13-4eee-42c4-833b-922b2078d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfccd13-4eee-42c4-833b-922b2078d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956571237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7a9121-6390-466d-afb3-1bc239755f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:03Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265908d4-91a4-42e8-a909-a6662c96a211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265908d4-91a4-42e8-a909-a6662c96a211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dadf744-cf0d-4fec-95b4-3763b03c72d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dadf744-cf0d-4fec-95b4-3763b03c72d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7a9121-6390-466d-afb3-1bc239755f72', 'volume_name': 'volume-1e7a9121-6390-466d-afb3-1bc239755f72', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02b6d2a-aadc-49ff-b59b-37f0cbadb4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02b6d2a-aadc-49ff-b59b-37f0cbadb4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829d472-1512-4e68-bdcc-79ae58396510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 1e7a9121-6390-466d-afb3-1bc239755f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7a9121-6390-466d-afb3-1bc239755f72', 'volume_size': 1}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (1e4e53b9-626d-46fc-9359-b6ed820e3789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0e0d63-e88c-4b72-b5e7-adf52b13e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0e0d63-e88c-4b72-b5e7-adf52b13e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489027387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708950ee-799f-4d19-a8ff-c7a37f9f531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:04Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc48008-cc2b-4fcc-987f-73628a94eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc48008-cc2b-4fcc-987f-73628a94eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b8fb3d-b42f-4c0e-b665-a7eb9d958598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b8fb3d-b42f-4c0e-b665-a7eb9d958598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708950ee-799f-4d19-a8ff-c7a37f9f531b', 'volume_name': 'volume-708950ee-799f-4d19-a8ff-c7a37f9f531b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a9a825-feff-4c8e-a5e1-7cf9265cf7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a9a825-feff-4c8e-a5e1-7cf9265cf7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f516bc-9f5c-435e-b77c-9010d74e084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Volume 708950ee-799f-4d19-a8ff-c7a37f9f531b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708950ee-799f-4d19-a8ff-c7a37f9f531b', 'volume_size': 1}
Jul 07 03:54:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (a710c9ea-d30e-4962-b173-7e4769292cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a4a23d-f5f0-407d-ac75-612c4214689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a4a23d-f5f0-407d-ac75-612c4214689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665771472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eb1790-a97d-492b-9978-8c2840027259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:04Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce300f85-de16-43cc-ba28-3700a408e133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce300f85-de16-43cc-ba28-3700a408e133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46313c95-4c1a-4ead-b8be-df10221cc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46313c95-4c1a-4ead-b8be-df10221cc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6eb1790-a97d-492b-9978-8c2840027259', 'volume_name': 'volume-c6eb1790-a97d-492b-9978-8c2840027259', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0794a-043e-4801-adb3-26bd400c3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0794a-043e-4801-adb3-26bd400c3f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed39cca-cc61-4a1d-bd1c-993b6d8976fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Volume c6eb1790-a97d-492b-9978-8c2840027259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6eb1790-a97d-492b-9978-8c2840027259', 'volume_size': 1}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:04 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 1073741824" returned: 0 in 1.102s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:04 devstack sudo[104527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357
Jul 07 03:54:04 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (053ab7bb-4074-47a8-b940-d3cc9413326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6706f-33aa-48fa-b5b1-baec430c64f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d6706f-33aa-48fa-b5b1-baec430c64f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794709153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d952fe-c713-4708-a17b-ae31264a4649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:05Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd62df2-a9aa-498d-b429-439d24117200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd62df2-a9aa-498d-b429-439d24117200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67037aeb-642c-4c9b-bc82-f33066f47364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67037aeb-642c-4c9b-bc82-f33066f47364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d952fe-c713-4708-a17b-ae31264a4649', 'volume_name': 'volume-38d952fe-c713-4708-a17b-ae31264a4649', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca72741-a619-4fb8-82a9-22f55cc3e113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca72741-a619-4fb8-82a9-22f55cc3e113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907577bd-b021-45e8-8dc2-f476b1116dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:04 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Volume 38d952fe-c713-4708-a17b-ae31264a4649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d952fe-c713-4708-a17b-ae31264a4649', 'volume_size': 1}
Jul 07 03:54:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (b70fe071-f3d0-45af-8fb3-555b4d5ed8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17256946-21a7-4fa7-bde4-870495592a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17256946-21a7-4fa7-bde4-870495592a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555627256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d0321b-b65f-469d-aba9-e2053a56b041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:05Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4d26c0-d396-4d26-871c-00159fa896c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4d26c0-d396-4d26-871c-00159fa896c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3390ea-f860-4f8d-9b55-934b42f96628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3390ea-f860-4f8d-9b55-934b42f96628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d0321b-b65f-469d-aba9-e2053a56b041', 'volume_name': 'volume-75d0321b-b65f-469d-aba9-e2053a56b041', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101fa197-0263-42cf-bc55-85cac03a1e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101fa197-0263-42cf-bc55-85cac03a1e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65a91b1-a15c-49e8-b310-cef6d11a41c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Volume 75d0321b-b65f-469d-aba9-e2053a56b041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d0321b-b65f-469d-aba9-e2053a56b041', 'volume_size': 1}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:05 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357" returned: 0 in 0.818s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.805s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956571237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7a9121-6390-466d-afb3-1bc239755f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:03Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 1e7a9121-6390-466d-afb3-1bc239755f72 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:05 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b981fc4-b496-41b9-bbf3-e71556fe4a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7ec8e4-7d57-456e-923b-41c7c4ce4baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 1073741824
Jul 07 03:54:05 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Volume volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 (eccd7a93-e947-4754-b4dd-61e9f8ec2357): created successfully
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7ec8e4-7d57-456e-923b-41c7c4ce4baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Flow 'volume_create_manager' (fa42a075-c274-4305-b0db-44ab3561ff88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8cea0f46-23d4-4b39-ba34-e99be3d86c35 tempest-CinderUnicodeTest-1664983883 None] Created volume successfully.
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (309fd686-0e69-4db2-89cd-26b81623dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377b01d-9583-442d-9b40-b0d2547c7e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7377b01d-9583-442d-9b40-b0d2547c7e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484491805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f449593c-e958-494b-9a13-018753d48ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:06Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a509f5f-9ac5-4a67-9a12-1e1456ccd1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a509f5f-9ac5-4a67-9a12-1e1456ccd1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb22d84b-e6de-43e4-9e64-0b75f43e33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb22d84b-e6de-43e4-9e64-0b75f43e33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f449593c-e958-494b-9a13-018753d48ce1', 'volume_name': 'volume-f449593c-e958-494b-9a13-018753d48ce1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af879619-9f9c-4d66-8f83-33c00e337b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af879619-9f9c-4d66-8f83-33c00e337b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00496102-46c0-4d27-88b2-345d748a3ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Volume f449593c-e958-494b-9a13-018753d48ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f449593c-e958-494b-9a13-018753d48ce1', 'volume_size': 1}
Jul 07 03:54:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:06 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 1073741824" returned: 0 in 0.963s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:06 devstack sudo[104536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72
Jul 07 03:54:06 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Flow 'volume_create_manager' (9e62329f-b726-4929-8c77-2024903ed8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ba4f1d-0f21-414c-bd30-517bea885398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ba4f1d-0f21-414c-bd30-517bea885398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1525079960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04943f61-3d56-47e3-8210-6e8fe127e794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377308db38eb4c55aa413ce1f52901f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:07Z,use_quota=True,user_id='ac9e51a57fc5483cb9eaffbb7e68c029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d43db-d1fc-42fb-ba2e-e00b18a02fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281d43db-d1fc-42fb-ba2e-e00b18a02fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5724fc-1aae-4f2f-ba17-c03bbfafbb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5724fc-1aae-4f2f-ba17-c03bbfafbb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04943f61-3d56-47e3-8210-6e8fe127e794', 'volume_name': 'volume-04943f61-3d56-47e3-8210-6e8fe127e794', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba6fa46-501a-4743-85a2-97f9d75110d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba6fa46-501a-4743-85a2-97f9d75110d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c798bcf5-9adb-460b-8c83-7d751a2578d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:06 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Volume 04943f61-3d56-47e3-8210-6e8fe127e794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04943f61-3d56-47e3-8210-6e8fe127e794', 'volume_size': 1}
Jul 07 03:54:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:07 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72" returned: 0 in 0.702s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.175s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489027387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708950ee-799f-4d19-a8ff-c7a37f9f531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:04Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Creating volume 708950ee-799f-4d19-a8ff-c7a37f9f531b {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:07 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:07 devstack sudo[104539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b 1073741824
Jul 07 03:54:07 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829d472-1512-4e68-bdcc-79ae58396510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7a9121-6390-466d-afb3-1bc239755f72', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17abb65-d28d-4462-ae99-315631a777c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-1e7a9121-6390-466d-afb3-1bc239755f72 (1e7a9121-6390-466d-afb3-1bc239755f72): created successfully
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17abb65-d28d-4462-ae99-315631a777c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (6c72cf13-6681-468e-a745-769e67a02e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2626b5d5-3c80-40c5-a904-f1445dc1e0e4 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Flow 'volume_create_manager' (7ea9ef3e-8e6c-4972-afd5-adce689d3189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e9ea1a-5798-45ec-b70d-421af7451ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6e9ea1a-5798-45ec-b70d-421af7451ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c794a8853947d591e8b283b8fcb643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:07Z,use_quota=True,user_id='3092b43bdfee42a8b8cf3217d967c92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17aeca6-67b0-4116-a444-420c5883ca56),volume_type_id=a17aeca6-67b0-4116-a444-420c5883ca56)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e8257-d1e7-4e42-a180-d30dac497e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539e8257-d1e7-4e42-a180-d30dac497e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520379c5-d027-40cc-b105-4bb74d3de440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (520379c5-d027-40cc-b105-4bb74d3de440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae', 'volume_name': 'volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae', 'volume_size': 1, 'image_id': '88195770-aae7-4487-83c4-9a0e96600100', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f0c0fdaf8cce8667801bc421c07eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34c794a8853947d591e8b283b8fcb643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98318bbfab02746fa9ea396285ca7e89fdd1c636e8feecb3da813158ec5ce8ea45e50f5ee9b9c0e6bf0422b645d46e34c7117a62b20efd83d51ee19ddce4ea5e', 'id': '88195770-aae7-4487-83c4-9a0e96600100', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88195770-aae7-4487-83c4-9a0e96600100/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5c1040>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a6cd91-b8be-45dd-aaa0-f1d2683003cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a6cd91-b8be-45dd-aaa0-f1d2683003cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bd4a75-9bae-491f-9ebc-715ce3949d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae', 'volume_size': 1, 'image_id': '88195770-aae7-4487-83c4-9a0e96600100', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f0c0fdaf8cce8667801bc421c07eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34c794a8853947d591e8b283b8fcb643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98318bbfab02746fa9ea396285ca7e89fdd1c636e8feecb3da813158ec5ce8ea45e50f5ee9b9c0e6bf0422b645d46e34c7117a62b20efd83d51ee19ddce4ea5e', 'id': '88195770-aae7-4487-83c4-9a0e96600100', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88195770-aae7-4487-83c4-9a0e96600100/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5c1040>}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Trying to clone b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae from image 88195770-aae7-4487-83c4-9a0e96600100 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:54:07 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc13708-8fec-4226-8f47-7a654294b804]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:07 devstack sudo[104543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:07 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (6e137a3b-c9ff-4193-b039-77e9cb464466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb408ed4-a69a-46d1-90e7-d339617e7d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb408ed4-a69a-46d1-90e7-d339617e7d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663230662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8539c3a4-3000-4ca6-8de1-a4c8de8a230a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:08Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d987c6d-23eb-4cad-9eb2-cb557dde33b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d987c6d-23eb-4cad-9eb2-cb557dde33b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea176d42-0d94-484c-8160-359197a119dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:07 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea176d42-0d94-484c-8160-359197a119dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8539c3a4-3000-4ca6-8de1-a4c8de8a230a', 'volume_name': 'volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15beaa0-d088-405e-b9d8-612a949ff950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c15beaa0-d088-405e-b9d8-612a949ff950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dab482-32cf-4864-a68c-c37861bb32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 8539c3a4-3000-4ca6-8de1-a4c8de8a230a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a', 'volume_size': 1}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:08 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b 1073741824" returned: 0 in 0.920s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:08 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b
Jul 07 03:54:08 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (000a0e9f-9a6d-45a1-bf23-a9dc03646fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d5bcc-5979-4168-9cec-a52865e335bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d5bcc-5979-4168-9cec-a52865e335bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126096961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565598f0-2279-4c4c-9712-ccd010de979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:08Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b76000-9eb2-4368-9b3d-6c97e62f12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b76000-9eb2-4368-9b3d-6c97e62f12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c41a5-848c-45e9-b1ff-1b49c74697fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c41a5-848c-45e9-b1ff-1b49c74697fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565598f0-2279-4c4c-9712-ccd010de979e', 'volume_name': 'volume-565598f0-2279-4c4c-9712-ccd010de979e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14157d28-68fb-4c24-901b-6dce7fb1cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14157d28-68fb-4c24-901b-6dce7fb1cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9ec060-2022-4503-8c76-c177a1e3f1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 565598f0-2279-4c4c-9712-ccd010de979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565598f0-2279-4c4c-9712-ccd010de979e', 'volume_size': 1}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:08 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 0 in 0.935s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:08 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:08 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (1c937096-aca5-4f88-93dc-847b2715a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291f980d-9459-4336-8c6c-3fd33eca259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291f980d-9459-4336-8c6c-3fd33eca259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387152815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5cc53-c770-4927-aa34-8033773762f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:09Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd24b0b3-8cbe-4209-9e2c-3538236b7c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd24b0b3-8cbe-4209-9e2c-3538236b7c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d5d303-e862-4242-ab74-1960b7af6c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d5d303-e862-4242-ab74-1960b7af6c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a5cc53-c770-4927-aa34-8033773762f2', 'volume_name': 'volume-12a5cc53-c770-4927-aa34-8033773762f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b33728-9b37-474c-9fa9-806530b465e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b33728-9b37-474c-9fa9-806530b465e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c94da6-3e8b-46f0-9437-02993b46fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 12a5cc53-c770-4927-aa34-8033773762f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a5cc53-c770-4927-aa34-8033773762f2', 'volume_size': 1}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.562s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-665771472',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6eb1790-a97d-492b-9978-8c2840027259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:04Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Creating volume c6eb1790-a97d-492b-9978-8c2840027259 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:08 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:08 devstack sudo[104554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 1073741824
Jul 07 03:54:08 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f516bc-9f5c-435e-b77c-9010d74e084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708950ee-799f-4d19-a8ff-c7a37f9f531b', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83448b47-1ca6-4666-8bc1-576665be59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Volume volume-708950ee-799f-4d19-a8ff-c7a37f9f531b (708950ee-799f-4d19-a8ff-c7a37f9f531b): created successfully
Jul 07 03:54:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83448b47-1ca6-4666-8bc1-576665be59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (1e4e53b9-626d-46fc-9359-b6ed820e3789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-dc4911b7-27e1-4d20-9d32-5b0631ad5cf4 tempest-CreateVolumesFromImageTest-1163902533 None] Created volume successfully.
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (988810b4-db3e-499c-b845-462861428386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88f2bf3-1838-4972-925c-b0ba28ed6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88f2bf3-1838-4972-925c-b0ba28ed6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402040110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458267f8-62fb-414a-a214-8b5f7be4cdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:09Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc1240-de0b-48f8-adea-cf2ab4a6d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc1240-de0b-48f8-adea-cf2ab4a6d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c40c96-f20f-47c5-bd86-72cec330b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c40c96-f20f-47c5-bd86-72cec330b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458267f8-62fb-414a-a214-8b5f7be4cdf5', 'volume_name': 'volume-458267f8-62fb-414a-a214-8b5f7be4cdf5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad439cf2-24d6-4c0b-9f18-d4e80f64a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad439cf2-24d6-4c0b-9f18-d4e80f64a37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdb21b7-8e03-4073-b34e-4ebaff72fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 458267f8-62fb-414a-a214-8b5f7be4cdf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458267f8-62fb-414a-a214-8b5f7be4cdf5', 'volume_size': 1}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:09 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Temporary image 88195770-aae7-4487-83c4-9a0e96600100 is fetched for user 3092b43bdfee42a8b8cf3217d967c92b. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (19d7898b-c909-4fa9-8d68-d5e78ac7ad04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a006652-dd95-4b7f-9a17-b9853149781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2d5dad-2b65-4337-a4ee-09b883547c49]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a006652-dd95-4b7f-9a17-b9853149781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705054201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0fb40f-ad73-433a-b000-aecc4bd9d10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:10Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a47861-1e22-442f-b31b-b0375f5018f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a47861-1e22-442f-b31b-b0375f5018f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348958cd-520e-41be-95ee-e48270f977ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348958cd-520e-41be-95ee-e48270f977ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f0fb40f-ad73-433a-b000-aecc4bd9d10a', 'volume_name': 'volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88388d22-7a2f-4115-8404-5c0d4f96a722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88388d22-7a2f-4115-8404-5c0d4f96a722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592f6ac4-32fa-4ec7-b986-f65a47644c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:09 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume 6f0fb40f-ad73-433a-b000-aecc4bd9d10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a', 'volume_size': 1}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:09 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:09 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:09 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 1073741824" returned: 0 in 1.018s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:10 devstack sudo[104566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259
Jul 07 03:54:10 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:10 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:10 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:10 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:10 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.822s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794709153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d952fe-c713-4708-a17b-ae31264a4649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:05Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Creating volume 38d952fe-c713-4708-a17b-ae31264a4649 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:10 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed39cca-cc61-4a1d-bd1c-993b6d8976fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6eb1790-a97d-492b-9978-8c2840027259', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:10 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 1073741824
Jul 07 03:54:10 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60b2124-6e0a-4e1b-ac10-498715a8ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:10 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Volume volume-c6eb1790-a97d-492b-9978-8c2840027259 (c6eb1790-a97d-492b-9978-8c2840027259): created successfully
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60b2124-6e0a-4e1b-ac10-498715a8ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:10 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (a710c9ea-d30e-4962-b173-7e4769292cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ca400660-fe67-4fed-b3ff-e70601be1f7c tempest-CreateVolumesFromImageTest-1163902533 None] Created volume successfully.
Jul 07 03:54:11 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 1 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:11 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 1073741824" returned: 0 in 0.829s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:11 devstack sudo[104581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649
Jul 07 03:54:11 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:12 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649" returned: 0 in 0.639s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.961s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-555627256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d0321b-b65f-469d-aba9-e2053a56b041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:05Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Creating volume 75d0321b-b65f-469d-aba9-e2053a56b041 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907577bd-b021-45e8-8dc2-f476b1116dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d952fe-c713-4708-a17b-ae31264a4649', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:12 devstack sudo[104584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 1073741824
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583a9689-0836-4b6d-99fe-097dba9d8260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:12 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Volume volume-38d952fe-c713-4708-a17b-ae31264a4649 (38d952fe-c713-4708-a17b-ae31264a4649): created successfully
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (583a9689-0836-4b6d-99fe-097dba9d8260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (053ab7bb-4074-47a8-b940-d3cc9413326b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8c6c0d48-c452-4557-8f64-9b22bb67ae75 tempest-CreateVolumesFromImageTest-1163902533 None] Created volume successfully.
Jul 07 03:54:12 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 1073741824" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:13 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041
Jul 07 03:54:13 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:13 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.990s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484491805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f449593c-e958-494b-9a13-018753d48ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c900bb1084b4f90b46de10332a8ed4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:06Z,use_quota=True,user_id='bcb1f33089a74d36b91b091fa58cc2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Creating volume f449593c-e958-494b-9a13-018753d48ce1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:13 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:13 devstack sudo[104593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 1073741824
Jul 07 03:54:13 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65a91b1-a15c-49e8-b310-cef6d11a41c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d0321b-b65f-469d-aba9-e2053a56b041', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3151c5-aa2c-4add-a968-ac1ed74b8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Volume volume-75d0321b-b65f-469d-aba9-e2053a56b041 (75d0321b-b65f-469d-aba9-e2053a56b041): created successfully
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3151c5-aa2c-4add-a968-ac1ed74b8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (b70fe071-f3d0-45af-8fb3-555b4d5ed8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4d5c10a8-8202-4bc5-bb68-a9b6a6fb83b0 tempest-CreateVolumesFromImageTest-1163902533 None] Created volume successfully.
Jul 07 03:54:14 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 1073741824" returned: 0 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:14 devstack sudo[104599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1
Jul 07 03:54:14 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:15 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.230s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1525079960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04943f61-3d56-47e3-8210-6e8fe127e794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='377308db38eb4c55aa413ce1f52901f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:07Z,use_quota=True,user_id='ac9e51a57fc5483cb9eaffbb7e68c029',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Creating volume 04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:15 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00496102-46c0-4d27-88b2-345d748a3ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f449593c-e958-494b-9a13-018753d48ce1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:15 devstack sudo[104602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 1073741824
Jul 07 03:54:15 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a79fd93-2570-42a2-ad4b-a84ad3d46abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Volume volume-f449593c-e958-494b-9a13-018753d48ce1 (f449593c-e958-494b-9a13-018753d48ce1): created successfully
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a79fd93-2570-42a2-ad4b-a84ad3d46abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Flow 'volume_create_manager' (309fd686-0e69-4db2-89cd-26b81623dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-23f5b494-14ec-444b-8f3e-5c76959974b9 tempest-CreateVolumesFromImageTest-1163902533 None] Created volume successfully.
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:15 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:15 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-f449593c-e958-494b-9a13-018753d48ce1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-f449593c-e958-494b-9a13-018753d48ce1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-quobyte-f449593c-e958-494b-9a13-018753d48ce1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-f449593c-e958-494b-9a13-018753d48ce1" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd75c48-79f2-43a5-83bc-0444fb0ef63d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:15 devstack sudo[104606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1
Jul 07 03:54:15 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:16 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:54:16 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 1073741824" returned: 0 in 0.882s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:16 devstack sudo[104613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794
Jul 07 03:54:16 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:16 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1" returned: 0 in 0.796s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:16 devstack sudo[104618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1
Jul 07 03:54:16 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:16 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.790s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663230662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8539c3a4-3000-4ca6-8de1-a4c8de8a230a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:08Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 8539c3a4-3000-4ca6-8de1-a4c8de8a230a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:16 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a 1073741824
Jul 07 03:54:16 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c798bcf5-9adb-460b-8c83-7d751a2578d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04943f61-3d56-47e3-8210-6e8fe127e794', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d4498-3af6-424f-adc2-5324f441de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Volume volume-04943f61-3d56-47e3-8210-6e8fe127e794 (04943f61-3d56-47e3-8210-6e8fe127e794): created successfully
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13d4498-3af6-424f-adc2-5324f441de26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Flow 'volume_create_manager' (9e62329f-b726-4929-8c77-2024903ed8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a91fdb09-98c7-4d31-93e5-1ea571a64794 tempest-CinderUnicodeTest-1664983883 None] Created volume successfully.
Jul 07 03:54:17 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-f449593c-e958-494b-9a13-018753d48ce1" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-f449593c-e958-494b-9a13-018753d48ce1" released by "delete_volume" :: held 1.520s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Created reservations ['67784802-513a-4c24-8773-f51a74d10103', '2f94f854-e2ff-4e7c-904c-605a140b9358', '7e209bb7-886f-47a1-9052-00b5713880cd', 'c79a032d-f74b-4d83-805d-089838a1ac9e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:17 devstack sudo[104624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:17 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:17 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a 1073741824" returned: 0 in 0.986s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-75d0321b-b65f-469d-aba9-e2053a56b041-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-75d0321b-b65f-469d-aba9-e2053a56b041-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:17 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a
Jul 07 03:54:17 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-quobyte-75d0321b-b65f-469d-aba9-e2053a56b041" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:17 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-75d0321b-b65f-469d-aba9-e2053a56b041" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fae3f-4b7d-40be-b5ff-0a9bf6d71237]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:18 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.795s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Deleted volume successfully.
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb5d72e1-9655-4d5c-aec3-89071b65d92a tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-f449593c-e958-494b-9a13-018753d48ce1-delete_volume" released by "delete_volume" :: held 2.544s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:18 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041
Jul 07 03:54:18 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:18 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" returned: 0 in 0.729s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.124s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-126096961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=565598f0-2279-4c4c-9712-ccd010de979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:08Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 565598f0-2279-4c4c-9712-ccd010de979e {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:18 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:18 devstack sudo[104637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e 1073741824
Jul 07 03:54:18 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dab482-32cf-4864-a68c-c37861bb32b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fbf9bd-a259-4610-9a40-e4e1af88e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a (8539c3a4-3000-4ca6-8de1-a4c8de8a230a): created successfully
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80fbf9bd-a259-4610-9a40-e4e1af88e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (6e137a3b-c9ff-4193-b039-77e9cb464466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bb57a1a6-72c7-49ef-be25-beb0178604d9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:18 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:18 devstack sudo[104642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041
Jul 07 03:54:18 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:19 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e 1073741824" returned: 0 in 0.828s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:19 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-75d0321b-b65f-469d-aba9-e2053a56b041" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:19 devstack sudo[104649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e
Jul 07 03:54:19 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-75d0321b-b65f-469d-aba9-e2053a56b041" released by "delete_volume" :: held 1.544s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Created reservations ['fb72be17-a8c7-4866-97b5-09b8b9138a18', 'a8159e21-9318-4648-a0b7-faf31e7115f0', '29d11d81-a591-42a1-a6ec-4266dbdb48d8', 'cbed5a91-61c4-409c-8cc4-63e895e9bae1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:19 devstack sudo[104651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:19 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-38d952fe-c713-4708-a17b-ae31264a4649-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:20 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-38d952fe-c713-4708-a17b-ae31264a4649-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.245s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387152815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a5cc53-c770-4927-aa34-8033773762f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:09Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 12a5cc53-c770-4927-aa34-8033773762f2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:20 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9ec060-2022-4503-8c76-c177a1e3f1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565598f0-2279-4c4c-9712-ccd010de979e', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:20 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 1073741824
Jul 07 03:54:20 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f1a0f3-6df4-462c-b7d5-4635881a1f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:20 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-565598f0-2279-4c4c-9712-ccd010de979e (565598f0-2279-4c4c-9712-ccd010de979e): created successfully
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f1a0f3-6df4-462c-b7d5-4635881a1f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (000a0e9f-9a6d-45a1-bf23-a9dc03646fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ba5d5adf-db46-4dd6-bc44-597a07e54e61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-quobyte-38d952fe-c713-4708-a17b-ae31264a4649" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-38d952fe-c713-4708-a17b-ae31264a4649" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:20 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.676s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Deleted volume successfully.
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7e2f5b-969d-44a5-a7b4-0ae7e07e005f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fb3c0d54-9da3-4757-897d-9052c659b658 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-75d0321b-b65f-469d-aba9-e2053a56b041-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:20 devstack sudo[104657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649
Jul 07 03:54:20 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:21 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 1073741824" returned: 0 in 0.838s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:21 devstack sudo[104667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2
Jul 07 03:54:21 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:21 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:21 devstack sudo[104669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649
Jul 07 03:54:21 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:21 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.355s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402040110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458267f8-62fb-414a-a214-8b5f7be4cdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:09Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 458267f8-62fb-414a-a214-8b5f7be4cdf5 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:21 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:21 devstack sudo[104673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 1073741824
Jul 07 03:54:21 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c94da6-3e8b-46f0-9437-02993b46fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a5cc53-c770-4927-aa34-8033773762f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4fe6d3-777e-4286-8b77-d37978df0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:21 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-12a5cc53-c770-4927-aa34-8033773762f2 (12a5cc53-c770-4927-aa34-8033773762f2): created successfully
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4fe6d3-777e-4286-8b77-d37978df0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:21 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (1c937096-aca5-4f88-93dc-847b2715a913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-38d952fe-c713-4708-a17b-ae31264a4649" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-38d952fe-c713-4708-a17b-ae31264a4649" released by "delete_volume" :: held 1.519s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a3ff91c3-b0ec-4aaa-9419-57d38be8ba6e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Created reservations ['377ca47e-81da-4fc3-ad9d-c27226d6cc03', '063374e7-3e82-42f7-ab35-99fc0ac2165f', 'dfa43e41-0e10-4f83-a4bc-ddd266e2f2b3', 'bd1d8cf2-dfab-4c8c-8ac5-5f8b250ce65c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:21 devstack sudo[104675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:21 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-c6eb1790-a97d-492b-9978-8c2840027259-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-c6eb1790-a97d-492b-9978-8c2840027259-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-quobyte-c6eb1790-a97d-492b-9978-8c2840027259" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-c6eb1790-a97d-492b-9978-8c2840027259" acquired by "delete_volume" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae3a53c-b420-4f0b-bf67-7d8a8bb4adcd]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:22 devstack sudo[104681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259
Jul 07 03:54:22 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:22 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Deleted volume successfully.
Jul 07 03:54:22 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 1073741824" returned: 0 in 0.978s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cdd012c7-75e8-49f1-ac3d-ac724d855e17 tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-38d952fe-c713-4708-a17b-ae31264a4649-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:22 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5
Jul 07 03:54:22 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:23 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259" returned: 0 in 0.803s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:23 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259
Jul 07 03:54:23 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:23 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5" returned: 0 in 0.677s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.765s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1705054201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f0fb40f-ad73-433a-b000-aecc4bd9d10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20d0d308932a4502b937f4a7c51bca46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:10Z,use_quota=True,user_id='f133469d904743699ffc9f40af012bdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Creating volume 6f0fb40f-ad73-433a-b000-aecc4bd9d10a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:23 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:23 devstack sudo[104692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a 1073741824
Jul 07 03:54:23 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfdb21b7-8e03-4073-b34e-4ebaff72fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458267f8-62fb-414a-a214-8b5f7be4cdf5', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379a525a-cc4e-4870-8354-bda4dde4a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 (458267f8-62fb-414a-a214-8b5f7be4cdf5): created successfully
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379a525a-cc4e-4870-8354-bda4dde4a93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (988810b4-db3e-499c-b845-462861428386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-49e85473-de6d-47cd-940b-216658e3975e tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:23 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-c6eb1790-a97d-492b-9978-8c2840027259" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-c6eb1790-a97d-492b-9978-8c2840027259" released by "delete_volume" :: held 1.502s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Created reservations ['505885b0-34e8-4ba0-a8a2-715d62cd91fe', 'dccb6e2e-b214-442c-8691-e4b6193003f5', '124c2332-275f-478d-9a67-1d50b24a44de', '0a6e0b87-5808-4e33-865b-6a8d80187cdc'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:24 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:24 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:24 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a 1073741824" returned: 0 in 0.949s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:24 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a
Jul 07 03:54:24 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-708950ee-799f-4d19-a8ff-c7a37f9f531b-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-708950ee-799f-4d19-a8ff-c7a37f9f531b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "cinder-quobyte-708950ee-799f-4d19-a8ff-c7a37f9f531b" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-708950ee-799f-4d19-a8ff-c7a37f9f531b" acquired by "delete_volume" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4455eb85-0c68-4ff1-ab13-9ceaa09985da]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:24 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.743s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Deleted volume successfully.
Jul 07 03:54:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7855e12-18c8-4890-b461-f47a1ec3db1b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-c6eb1790-a97d-492b-9978-8c2840027259-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:24 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b
Jul 07 03:54:24 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:25 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" returned: 0 in 0.707s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.035s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c794a8853947d591e8b283b8fcb643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:07Z,use_quota=True,user_id='3092b43bdfee42a8b8cf3217d967c92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17aeca6-67b0-4116-a444-420c5883ca56),volume_type_id=a17aeca6-67b0-4116-a444-420c5883ca56)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Creating volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:25 devstack sudo[104706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1073741824
Jul 07 03:54:25 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592f6ac4-32fa-4ec7-b986-f65a47644c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5a6994-f212-4040-8eb4-e02b4928852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Volume volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a (6f0fb40f-ad73-433a-b000-aecc4bd9d10a): created successfully
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb5a6994-f212-4040-8eb4-e02b4928852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Flow 'volume_create_manager' (19d7898b-c909-4fa9-8d68-d5e78ac7ad04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0b62d6ee-9b4f-4818-97f8-6b0b0e29cbc9 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created volume successfully.
Jul 07 03:54:25 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:25 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b
Jul 07 03:54:25 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-6f0fb40f-ad73-433a-b000-aecc4bd9d10a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-6f0fb40f-ad73-433a-b000-aecc4bd9d10a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" acquired by "delete_volume" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdaed2a-cc7a-4983-8c69-a18a0f67a37c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:26 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1073741824" returned: 0 in 0.963s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:26 devstack sudo[104717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:26 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:26 devstack sudo[104716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a
Jul 07 03:54:26 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:26 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-708950ee-799f-4d19-a8ff-c7a37f9f531b" returned: 0 in 0.735s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-quobyte-708950ee-799f-4d19-a8ff-c7a37f9f531b" released by "delete_volume" :: held 1.595s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Created reservations ['0f8b5ae3-96d2-47b8-8949-d858e0b83601', '23ea20cf-a749-4ccf-aedc-fc2d7031a6b4', 'edef4880-fde4-4700-9925-a642c7ab5bcd', '80ff2fb6-ad27-464b-9bd1-c0f1588e6f10'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:26 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:26 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:26 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 0 in 0.697s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.966s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Creating offline snapshot 9f5844d5-d672-4722-9275-ed543e85b57d of volume 04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:54:26 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Attempting download of 88195770-aae7-4487-83c4-9a0e96600100 ((None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}])) to volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" returned: 0 in 0.863s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0463604-5bb3-481e-a2f0-5f86e6bfe7b9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:26 devstack sudo[104727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a
Jul 07 03:54:26 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff31d1d-e219-459a-b559-ce601df9bf42]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:27 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794
Jul 07 03:54:27 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:27 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo
Jul 07 03:54:27 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:27 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.966s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Deleted volume successfully.
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18fdfec-b5ca-423b-a1c1-de1b050d6e4b tempest-CreateVolumesFromImageTest-1163902533 None] Lock "cinder-708950ee-799f-4d19-a8ff-c7a37f9f531b-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:27 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:27 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" returned: 0 in 1.043s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794" returned: 0 in 1.037s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-6f0fb40f-ad73-433a-b000-aecc4bd9d10a" released by "delete_volume" :: held 1.964s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:28 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d 1G
Jul 07 03:54:28 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:28 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo" returned: 0 in 1.026s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['c5573e3e-b12c-431e-8458-f7cf13affc8a', 'c04fe58e-1501-4fad-b0e6-bf2e1668b51e', '8c775b91-709a-4125-9b0d-ee6ec3409deb', '1a34b9d5-f997-4505-90b7-4118801eb22c'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:28 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo
Jul 07 03:54:28 devstack sudo[104744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:28 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:28 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-458267f8-62fb-414a-a214-8b5f7be4cdf5-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-458267f8-62fb-414a-a214-8b5f7be4cdf5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-458267f8-62fb-414a-a214-8b5f7be4cdf5" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-458267f8-62fb-414a-a214-8b5f7be4cdf5" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd83330-6f37-4a78-99c6-fd8b9aec8725]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:28 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5
Jul 07 03:54:28 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:29 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.000s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:29 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo" returned: 1 in 1.116s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88195770-aae7-4487-83c4-9a0e96600100_s132i4qo' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a87409e-296a-4168-bde1-2d0365df4efe]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d5d8d89e-c12d-4e40-856a-0d4f55661956 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-6f0fb40f-ad73-433a-b000-aecc4bd9d10a-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:29 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d 1G" returned: 0 in 1.260s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04943f61-3d56-47e3-8210-6e8fe127e794 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:29 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04943f61-3d56-47e3-8210-6e8fe127e794 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d
Jul 07 03:54:29 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:29 devstack sudo[104756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:29 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:29 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5" returned: 0 in 0.950s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:29 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5
Jul 07 03:54:29 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:30 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:30 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04943f61-3d56-47e3-8210-6e8fe127e794 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:30 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d is being set with open permissions: ugo+rw
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d
Jul 07 03:54:30 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:30 devstack sudo[104774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD
Jul 07 03:54:30 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:30 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-458267f8-62fb-414a-a214-8b5f7be4cdf5" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-458267f8-62fb-414a-a214-8b5f7be4cdf5" released by "delete_volume" :: held 1.900s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['e10a22a6-d339-43be-8f8d-63ddae808fe1', 'd747f89d-6d30-48da-9920-b6d7afd95d80', 'e3d1fa5d-9b13-4230-981f-5e9c336c0d61', '43db22b3-e937-4d1e-b66d-ad1ec2e6cbf0'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (a3b38892-425e-412e-968b-157ab686424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cc16e6-79c3-4142-a8b8-24c0c470af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cc16e6-79c3-4142-a8b8-24c0c470af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43227101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa114ba9-efc5-4610-935e-9cf3b892f3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:30Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d1e4a7-132e-4cc4-b9fe-f7446b259fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d1e4a7-132e-4cc4-b9fe-f7446b259fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb992b-6b28-4304-8333-7c98e947b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb992b-6b28-4304-8333-7c98e947b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa114ba9-efc5-4610-935e-9cf3b892f3e1', 'volume_name': 'volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2259355d-139c-417e-8691-db0d59cba7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2259355d-139c-417e-8691-db0d59cba7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1db966-d6cb-413c-81f9-626f4df753bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume aa114ba9-efc5-4610-935e-9cf3b892f3e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1', 'volume_size': 1}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:30 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d" returned: 0 in 0.682s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:30 devstack sudo[104778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:30 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-12a5cc53-c770-4927-aa34-8033773762f2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:30 devstack sudo[104780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info
Jul 07 03:54:30 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-12a5cc53-c770-4927-aa34-8033773762f2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-12a5cc53-c770-4927-aa34-8033773762f2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-12a5cc53-c770-4927-aa34-8033773762f2" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:30 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD" returned: 1 in 0.872s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] 88195770-aae7-4487-83c4-9a0e96600100 was raw, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10672e5-0d70-41eb-aed2-c1757540018d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:30 devstack sudo[104785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:30 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:31 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2
Jul 07 03:54:31 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:31 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info" returned: 0 in 0.733s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info is being set with open permissions: ugo+rw
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:31 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:31 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info
Jul 07 03:54:31 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1a299313-e2aa-4945-99fa-dda930ee3867 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-458267f8-62fb-414a-a214-8b5f7be4cdf5-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:31 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 0 in 0.794s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88195770-aae7-4487-83c4-9a0e96600100_6k0d48g_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:54:31 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:31 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1G
Jul 07 03:54:31 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:31 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:31 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2
Jul 07 03:54:31 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:32 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.info" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.338s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-43227101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa114ba9-efc5-4610-935e-9cf3b892f3e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:30Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:32 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:32 devstack sudo[104804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 1073741824
Jul 07 03:54:32 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cd3eb997-14c5-4112-8a01-b4ab0c3ae831 tempest-CinderUnicodeTest-1664983883 None] Create snapshot completed successfully
Jul 07 03:54:32 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae 1G" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:32 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-12a5cc53-c770-4927-aa34-8033773762f2" returned: 0 in 0.714s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-12a5cc53-c770-4927-aa34-8033773762f2" released by "delete_volume" :: held 1.633s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a1c6eb-293d-4008-9496-7528d8b5b3a7]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-9f5844d5-d672-4722-9275-ed543e85b57d-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['5c0f021c-ffd9-4324-85b0-ff3dff71a39e', 'd08340ab-2d47-4e3a-8228-106c2af48967', 'dd2279e9-7079-4118-92ae-12d3306d4285', 'ad538c69-f695-4eb6-adc4-7033287068ca'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-9f5844d5-d672-4722-9275-ed543e85b57d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:32 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:32 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-quobyte-9f5844d5-d672-4722-9275-ed543e85b57d" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-9f5844d5-d672-4722-9275-ed543e85b57d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Deleting offline snapshot 9f5844d5-d672-4722-9275-ed543e85b57d of volume 04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] snapshot_file for this snap is: volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38917be-b93d-4b4c-b42b-404f2d437783]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:32 devstack sudo[104812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:32 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:32 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d
Jul 07 03:54:32 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-565598f0-2279-4c4c-9712-ccd010de979e-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-565598f0-2279-4c4c-9712-ccd010de979e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-565598f0-2279-4c4c-9712-ccd010de979e" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-565598f0-2279-4c4c-9712-ccd010de979e" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[920dcc12-a08c-423f-85ea-30b31b6f9523]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:33 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 1073741824" returned: 0 in 1.089s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:33 devstack sudo[104825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1
Jul 07 03:54:33 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:33 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e
Jul 07 03:54:33 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:33 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 0 in 1.028s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:33 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.911s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:33 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:33 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f526bd93-96f1-4592-832f-c0ab1943aa2d tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-12a5cc53-c770-4927-aa34-8033773762f2-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:33 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d" returned: 0 in 1.132s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04943f61-3d56-47e3-8210-6e8fe127e794(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6b857-aba2-4843-acc4-ec128298b073]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:34 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794
Jul 07 03:54:34 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:34 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1" returned: 0 in 0.819s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1db966-d6cb-413c-81f9-626f4df753bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f98f986-1477-41c0-a4e7-85d67e905c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 (aa114ba9-efc5-4610-935e-9cf3b892f3e1): created successfully
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f98f986-1477-41c0-a4e7-85d67e905c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (a3b38892-425e-412e-968b-157ab686424e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fed494f2-254a-4e20-b5b2-14856e69754b tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:34 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e" returned: 0 in 1.002s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:34 devstack sudo[104841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e
Jul 07 03:54:34 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:34 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 1 in 0.987s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Downloaded image 88195770-aae7-4487-83c4-9a0e96600100 ((None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}])) to volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Temporary image 88195770-aae7-4487-83c4-9a0e96600100 for user 3092b43bdfee42a8b8cf3217d967c92b is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Marking volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Copying metadata from image 88195770-aae7-4487-83c4-9a0e96600100 to b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Creating volume glance metadata for volume b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae backed by image 88195770-aae7-4487-83c4-9a0e96600100 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '88195770-aae7-4487-83c4-9a0e96600100', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c9f0c0fdaf8cce8667801bc421c07eb5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bd4a75-9bae-491f-9ebc-715ce3949d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae', 'volume_size': 1, 'image_id': '88195770-aae7-4487-83c4-9a0e96600100', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88195770-aae7-4487-83c4-9a0e96600100', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9f0c0fdaf8cce8667801bc421c07eb5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34c794a8853947d591e8b283b8fcb643', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98318bbfab02746fa9ea396285ca7e89fdd1c636e8feecb3da813158ec5ce8ea45e50f5ee9b9c0e6bf0422b645d46e34c7117a62b20efd83d51ee19ddce4ea5e', 'id': '88195770-aae7-4487-83c4-9a0e96600100', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88195770-aae7-4487-83c4-9a0e96600100/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b4f5c1040>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b4614f-b1a6-42de-90fe-2567597c95e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Volume volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae (b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae): created successfully
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b4614f-b1a6-42de-90fe-2567597c95e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Flow 'volume_create_manager' (7ea9ef3e-8e6c-4972-afd5-adce689d3189) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:34 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-87ac2194-9bea-4d49-bdc1-c604e03414a5 tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Created volume successfully.
Jul 07 03:54:34 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794" returned: 0 in 0.945s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:34 devstack sudo[104850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d
Jul 07 03:54:34 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:34 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-565598f0-2279-4c4c-9712-ccd010de979e" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-565598f0-2279-4c4c-9712-ccd010de979e" released by "delete_volume" :: held 1.731s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['cd566c16-49bc-41e4-9cb2-e3026d1d1465', 'b5645bde-1380-41d5-9eda-f695a3933b7e', 'da2bbdeb-9d10-4b6a-bcd1-5f00564c21d3', '5d0003b5-e73e-451b-8731-6670102cc4a5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating offline snapshot fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 of volume aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36e7f93-2482-420f-a344-fe5697d6fdab]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:35 devstack sudo[104853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:35 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:35 devstack sudo[104852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1
Jul 07 03:54:35 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Acquiring lock "cinder-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "cinder-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Acquiring lock "cinder-quobyte-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "cinder-quobyte-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-8539c3a4-3000-4ca6-8de1-a4c8de8a230a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-8539c3a4-3000-4ca6-8de1-a4c8de8a230a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a5f8ed-f345-4ebb-b1b6-f76aad742830]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" acquired by "delete_volume" :: waited 0.051s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fe3f38-6afb-4dfe-99bb-872a71b72b11]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:35 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:35 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:35 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a
Jul 07 03:54:35 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:35 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d" returned: 0 in 1.028s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:35 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d
Jul 07 03:54:35 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:36 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.873s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fe2d3448-4b6d-4250-ae74-f95333b1ca71 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-565598f0-2279-4c4c-9712-ccd010de979e-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:36 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1" returned: 0 in 1.101s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:36 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 1G
Jul 07 03:54:36 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:36 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 0 in 1.014s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:36 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" returned: 0 in 0.993s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:36 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:36 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:36 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794.9f5844d5-d672-4722-9275-ed543e85b57d" returned: 0 in 0.771s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:36 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a
Jul 07 03:54:36 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-9f5844d5-d672-4722-9275-ed543e85b57d" released by "_delete_snapshot" :: held 4.004s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" released by "delete_snapshot" :: held 4.037s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Created reservations ['e10e8a4a-d9fe-4ff8-b591-dd437d5b0b7e', '476a3520-428b-4178-bf87-6c19b5da2523', '2ac84895-30e1-492d-bce9-d93ed04bbdb0', 'd1cf971c-4579-4fb5-8b89-3c13caa74807'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Delete snapshot completed successfully.
Jul 07 03:54:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a9a2416b-de61-476c-bd7b-e90969a8d146 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-9f5844d5-d672-4722-9275-ed543e85b57d-delete_snapshot" released by "delete_snapshot" :: held 4.227s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:37 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 1G" returned: 0 in 0.908s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:37 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0
Jul 07 03:54:37 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:37 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" returned: 0 in 0.685s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:37 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-8539c3a4-3000-4ca6-8de1-a4c8de8a230a" released by "delete_volume" :: held 1.734s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 1 in 0.838s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:37 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae
Jul 07 03:54:37 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['56087705-b225-4165-9ec4-3adf9b6cbdb1', '30c06efd-a5c9-4fd6-b962-1f77239ca903', 'f055d725-6eb3-4bfa-86e4-01b65620a667', '9972ac3b-91c7-4758-a296-df5e97a8c66b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:37 devstack sudo[104894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:37 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-1e7a9121-6390-466d-afb3-1bc239755f72-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-1e7a9121-6390-466d-afb3-1bc239755f72-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "cinder-quobyte-1e7a9121-6390-466d-afb3-1bc239755f72" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-1e7a9121-6390-466d-afb3-1bc239755f72" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d082231f-6e5c-463a-87ac-57771a978421]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:37 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" returned: 0 in 0.796s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:37 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 is being set with open permissions: ugo+rw
Jul 07 03:54:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:37 devstack sudo[104901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0
Jul 07 03:54:37 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-04943f61-3d56-47e3-8210-6e8fe127e794-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-04943f61-3d56-47e3-8210-6e8fe127e794-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:38 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72
Jul 07 03:54:38 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" acquired by "delete_volume" :: waited 0.033s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5286fe-5e09-4bce-b516-cbb102ed45ac]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:38 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" returned: 0 in 0.877s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "cinder-quobyte-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae" released by "delete_volume" :: held 2.871s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:38 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Created reservations ['a8bc4ec1-3193-4742-8a71-a4e996e7c60b', '2d84775e-3030-4af9-8da0-71abd7bfb2cf', '43dd43b4-f42e-4f06-96c7-d6f465c38541', '9ce57d4c-f680-4597-b9c2-227a01892ca7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.866s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:38 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794
Jul 07 03:54:38 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8129d25-1fc2-43f9-b47e-2193e571f5ab tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-8539c3a4-3000-4ca6-8de1-a4c8de8a230a-delete_volume" released by "delete_volume" :: held 2.949s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:38 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:38 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:38 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" returned: 0 in 0.766s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:38 devstack sudo[104911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info
Jul 07 03:54:38 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:39 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72" returned: 0 in 1.269s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:39 devstack sudo[104920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72
Jul 07 03:54:39 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:39 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794" returned: 0 in 1.012s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:39 devstack sudo[104922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794
Jul 07 03:54:39 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:39 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.902s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Deleted volume successfully.
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cc603a65-7587-4538-b43a-08a7cfac832b tempest-VolumeAndVolumeTypeFromImageTest-1299658401 None] Lock "cinder-b083fe35-1dcb-467f-9e4b-6ef36d7cf7ae-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:39 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info" returned: 0 in 0.928s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:39 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info is being set with open permissions: ugo+rw
Jul 07 03:54:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:39 devstack sudo[104927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info
Jul 07 03:54:39 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:40 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-04943f61-3d56-47e3-8210-6e8fe127e794" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:40 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1e7a9121-6390-466d-afb3-1bc239755f72" returned: 0 in 0.895s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-04943f61-3d56-47e3-8210-6e8fe127e794" released by "delete_volume" :: held 1.887s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-quobyte-1e7a9121-6390-466d-afb3-1bc239755f72" released by "delete_volume" :: held 2.231s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Created reservations ['40478379-348e-49a5-a576-0b1889de2f8d', 'f6b6b768-6135-4a9d-bbc8-d4d17315e19f', 'e990faff-ddb1-47aa-8554-bf67d7c459cf', '925bac5d-c4ab-4d33-a88f-f845cb10bfe8'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Created reservations ['28bae4a1-9196-4fd0-b2f3-2e50c4f642d3', 'cd9fed7a-d481-49e5-9db2-f31ca567582c', '3ddee8ab-f857-41a2-9d22-40b59820f250', '4be8ec98-26d2-4640-ba4b-b362785baa5b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:40 devstack sudo[104931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:40 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:40 devstack sudo[104933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:40 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-eccd7a93-e947-4754-b4dd-61e9f8ec2357-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-eccd7a93-e947-4754-b4dd-61e9f8ec2357-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "cinder-quobyte-eccd7a93-e947-4754-b4dd-61e9f8ec2357" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-eccd7a93-e947-4754-b4dd-61e9f8ec2357" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a2f85a-f9fb-441d-8226-79c692cf76f7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:40 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.info" returned: 0 in 0.993s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.607s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ef8ba83c-04f8-4405-9034-7c53b6af6f42 tempest-CreateVolumesFromSnapshotTest-5695848 None] Create snapshot completed successfully
Jul 07 03:54:40 devstack sudo[104936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357
Jul 07 03:54:40 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:40 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.761s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Deleted volume successfully.
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-373cd54a-b98e-43b7-8932-8c0a1ad33345 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-04943f61-3d56-47e3-8210-6e8fe127e794-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:41 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.922s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Deleted volume successfully.
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-149809f5-c0d7-4cc0-831e-013dccefee61 tempest-CreateVolumesFromSourceVolumeTest-862673620 None] Lock "cinder-1e7a9121-6390-466d-afb3-1bc239755f72-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:41 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357" returned: 0 in 1.056s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:41 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357
Jul 07 03:54:41 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (97ae0524-8391-47c3-8961-057cd3f06fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f3ea30-e640-4ec4-b4c2-8ec2680e15ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f3ea30-e640-4ec4-b4c2-8ec2680e15ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379894701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6378d18c-7f99-468f-a7e8-4f7b3281eb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:42Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390af21d-cded-40f9-93d1-a7d705cb8f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390af21d-cded-40f9-93d1-a7d705cb8f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7e038-5736-46c3-82fc-4ae2ad741bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff7e038-5736-46c3-82fc-4ae2ad741bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6378d18c-7f99-468f-a7e8-4f7b3281eb24', 'volume_name': 'volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b87d1f-8146-479b-a492-baf408af3e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b87d1f-8146-479b-a492-baf408af3e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2b568c-d938-42d6-8205-62af30cfc084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume 6378d18c-7f99-468f-a7e8-4f7b3281eb24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24', 'volume_size': 1}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-379894701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6378d18c-7f99-468f-a7e8-4f7b3281eb24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:42Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume 6378d18c-7f99-468f-a7e8-4f7b3281eb24 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:42 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:42 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 1073741824
Jul 07 03:54:42 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:42 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-eccd7a93-e947-4754-b4dd-61e9f8ec2357" returned: 0 in 1.061s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (a406a29b-01d4-4db4-bb02-b745a9e73840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caa6a22-6a92-44fb-a225-ce2f9eed76a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-quobyte-eccd7a93-e947-4754-b4dd-61e9f8ec2357" released by "delete_volume" :: held 2.227s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4caa6a22-6a92-44fb-a225-ce2f9eed76a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469563229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:43Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4ce266-ae89-48d1-b3a1-da3f986fcd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4ce266-ae89-48d1-b3a1-da3f986fcd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84790216-cc5c-499d-b921-8d7fd8b0d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84790216-cc5c-499d-b921-8d7fd8b0d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf', 'volume_name': 'volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908ede5a-9f18-432b-a92f-44eb61c116bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908ede5a-9f18-432b-a92f-44eb61c116bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732b2086-88dd-45c9-a2ca-062654bf6d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:42 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf', 'volume_size': 1}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Created reservations ['e4c072d2-a091-4f9b-bf41-d581d5a0a38d', 'ccb9a3d8-1534-4288-80e6-38ec5473ec8e', 'e0f9da5b-a750-410f-968b-99a194a3f818', '9a488b6d-8367-48cf-bb68-842aad866d7e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:43 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:43 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (2ddc566a-6b54-493e-9e46-8127cf946a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0824e6-9b3a-4cdd-88be-56b594a1a25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0824e6-9b3a-4cdd-88be-56b594a1a25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236762508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b91370-352e-48cb-91c1-c253f3627037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:43Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3172ae9-da67-4866-8c04-1714dc445c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3172ae9-da67-4866-8c04-1714dc445c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc76798a-c564-4797-81a6-ac03444d65c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc76798a-c564-4797-81a6-ac03444d65c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b91370-352e-48cb-91c1-c253f3627037', 'volume_name': 'volume-32b91370-352e-48cb-91c1-c253f3627037', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea73d4-4b71-4aa7-94a3-4205f513bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ea73d4-4b71-4aa7-94a3-4205f513bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:43 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1160bcee-99a1-40d5-9782-e4779b580587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume 32b91370-352e-48cb-91c1-c253f3627037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b91370-352e-48cb-91c1-c253f3627037', 'volume_size': 1}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 1073741824" returned: 0 in 1.570s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:43 devstack sudo[104954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24
Jul 07 03:54:43 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (001b4ea2-4ee2-4c0a-ba8a-96f0ffefca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cc283d-f7a3-4c09-be23-800a3c098adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.046s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Deleted volume successfully.
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cc283d-f7a3-4c09-be23-800a3c098adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516071978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff70a787-30b4-4c33-8106-29af0ac4120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:44Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceee2de2-fab2-4a25-a4f1-9b0c9c06d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceee2de2-fab2-4a25-a4f1-9b0c9c06d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70cfbbb-1427-46aa-8820-cf4a1401b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70cfbbb-1427-46aa-8820-cf4a1401b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff70a787-30b4-4c33-8106-29af0ac4120c', 'volume_name': 'volume-ff70a787-30b4-4c33-8106-29af0ac4120c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a66c13-01f8-4007-87c7-f3c4ab82f171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a66c13-01f8-4007-87c7-f3c4ab82f171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10a6132-54b1-4168-9821-6177735ac2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume ff70a787-30b4-4c33-8106-29af0ac4120c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff70a787-30b4-4c33-8106-29af0ac4120c', 'volume_size': 1}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3ca51d0e-a28f-41b7-9fa2-eea9ee40b1a5 tempest-CinderUnicodeTest-1664983883 None] Lock "cinder-eccd7a93-e947-4754-b4dd-61e9f8ec2357-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (69fda23a-043b-428c-80c3-bb2bcbe94511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943a8fdb-4ef2-4083-8703-c9d67d81e18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943a8fdb-4ef2-4083-8703-c9d67d81e18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160424273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0364822-f4ea-4874-9057-da619615ea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:45Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf15c4e-80e7-47da-b5cb-caf25b53668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf15c4e-80e7-47da-b5cb-caf25b53668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab292f7d-e27c-4165-b5ea-a4ba6aeb4244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab292f7d-e27c-4165-b5ea-a4ba6aeb4244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0364822-f4ea-4874-9057-da619615ea5c', 'volume_name': 'volume-a0364822-f4ea-4874-9057-da619615ea5c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73025657-254f-4511-aa77-2ab885c0c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73025657-254f-4511-aa77-2ab885c0c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c740bf38-d07a-487c-8843-408638b1eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume a0364822-f4ea-4874-9057-da619615ea5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0364822-f4ea-4874-9057-da619615ea5c', 'volume_size': 1}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24" returned: 0 in 0.824s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.784s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469563229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:43Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a2b568c-d938-42d6-8205-62af30cfc084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf 1073741824
Jul 07 03:54:44 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141c55c2-90ca-4711-a671-fd8c1b4ca482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 (6378d18c-7f99-468f-a7e8-4f7b3281eb24): created successfully
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141c55c2-90ca-4711-a671-fd8c1b4ca482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:44 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (97ae0524-8391-47c3-8961-057cd3f06fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2c067afd-d273-4308-aeec-c5439207dae6 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:45 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf 1073741824" returned: 0 in 1.176s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:46 devstack sudo[104997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf
Jul 07 03:54:46 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Flow 'volume_create_manager' (51b4a298-e011-4ce6-8eb3-4b9cd6de779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241e592f-45e0-4811-9e55-708b544b230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241e592f-45e0-4811-9e55-708b544b230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2041832457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55326773-7cd7-482e-a82d-8abaf9501caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621f5cd0c1ca44e4a53d4ab5e4c8061d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:46Z,use_quota=True,user_id='e54ae27ef15c43df83a136cba6160aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba390274-049c-4f82-bce5-0754b3c4dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba390274-049c-4f82-bce5-0754b3c4dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d861436-e6e3-4f88-8035-9cb406b308da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d861436-e6e3-4f88-8035-9cb406b308da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55326773-7cd7-482e-a82d-8abaf9501caf', 'volume_name': 'volume-55326773-7cd7-482e-a82d-8abaf9501caf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc63ecb7-2ce2-42e6-842b-9bd33b54b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc63ecb7-2ce2-42e6-842b-9bd33b54b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab5513-d254-4a37-91b3-9448b015fd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Volume 55326773-7cd7-482e-a82d-8abaf9501caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55326773-7cd7-482e-a82d-8abaf9501caf', 'volume_size': 1}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:46 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" returned: 0 in 0.792s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.963s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236762508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b91370-352e-48cb-91c1-c253f3627037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:43Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume 32b91370-352e-48cb-91c1-c253f3627037 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:46 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (732b2086-88dd-45c9-a2ca-062654bf6d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 1073741824
Jul 07 03:54:46 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04d1191-e4b9-41e6-847d-e7a76aa8207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:46 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf (b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf): created successfully
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04d1191-e4b9-41e6-847d-e7a76aa8207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:46 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (a406a29b-01d4-4db4-bb02-b745a9e73840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d0833a7a-5ecd-4a92-b0ce-304f52892c7a tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:47 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 1073741824" returned: 0 in 0.915s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:47 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037
Jul 07 03:54:47 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Flow 'volume_create_manager' (5a919fc9-3755-42bf-b7e7-dffb8507f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec496ba-0a19-4775-93d9-db4573a997a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1516071978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff70a787-30b4-4c33-8106-29af0ac4120c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:44Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume ff70a787-30b4-4c33-8106-29af0ac4120c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:48 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec496ba-0a19-4775-93d9-db4573a997a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3631b0-d3c6-4d01-a926-3b8b5ae11747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daff15478bc4f8a94336f329002c56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:48Z,use_quota=True,user_id='40afa672e3ba49adb13ef4d92135ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c 1073741824
Jul 07 03:54:48 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ecd21c-1be2-451d-a4c5-5c841a394538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ecd21c-1be2-451d-a4c5-5c841a394538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c55118-cb6a-4836-909d-2a52f0a7d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.image.glance [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Creating Keystone auth plugin from conf {{(pid=86955) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1160bcee-99a1-40d5-9782-e4779b580587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b91370-352e-48cb-91c1-c253f3627037', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c8015-6b26-4d82-a18f-6941f69e1dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-32b91370-352e-48cb-91c1-c253f3627037 (32b91370-352e-48cb-91c1-c253f3627037): created successfully
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c8015-6b26-4d82-a18f-6941f69e1dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (2ddc566a-6b54-493e-9e46-8127cf946a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:48 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0029cc7e-d8ba-41e7-ae99-c0720450d943 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c55118-cb6a-4836-909d-2a52f0a7d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d3631b0-d3c6-4d01-a926-3b8b5ae11747', 'volume_name': 'volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747', 'volume_size': 1, 'image_id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c95a0a9d1a703a88ef4e88ba3c3ba83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7daff15478bc4f8a94336f329002c56c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c3c2f831b354a7070cb59c996d90b0df72d7a16c76b20cfbe6e31f2654f32f913fccb83e6a4a4bf8ccbff9c70990fdad02dec97fa0e8c8f51630adb4560774', 'id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b44cd4e90>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4490e1e-ba28-4bee-a645-54ec5b19f7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4490e1e-ba28-4bee-a645-54ec5b19f7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d76998-7817-4aa5-a418-04a29399f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:48 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747', 'volume_size': 1, 'image_id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c95a0a9d1a703a88ef4e88ba3c3ba83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7daff15478bc4f8a94336f329002c56c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c3c2f831b354a7070cb59c996d90b0df72d7a16c76b20cfbe6e31f2654f32f913fccb83e6a4a4bf8ccbff9c70990fdad02dec97fa0e8c8f51630adb4560774', 'id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b44cd4e90>}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Trying to clone 8d3631b0-d3c6-4d01-a926-3b8b5ae11747 from image b7dd9528-99cd-419a-b4c5-57b3f4778cde at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}]). {{(pid=86955) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 03:54:48 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 03:54:48 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1698b-35ff-4fff-af0e-5d546f643485]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:49 devstack sudo[105013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:49 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:49 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c 1073741824" returned: 0 in 0.896s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:49 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c
Jul 07 03:54:49 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:49 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:49 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:49 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:50 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c" returned: 0 in 0.675s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.431s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1160424273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0364822-f4ea-4874-9057-da619615ea5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02f45dc5f3341cca0e2597daa484fc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:45Z,use_quota=True,user_id='99edb2261a9248d9a43a5ce0a91051b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Creating volume a0364822-f4ea-4874-9057-da619615ea5c {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:50 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10a6132-54b1-4168-9821-6177735ac2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff70a787-30b4-4c33-8106-29af0ac4120c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:50 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c 1073741824
Jul 07 03:54:50 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b710c3a-8d2b-4063-a87c-0e1f9f53962c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:50 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-ff70a787-30b4-4c33-8106-29af0ac4120c (ff70a787-30b4-4c33-8106-29af0ac4120c): created successfully
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b710c3a-8d2b-4063-a87c-0e1f9f53962c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (001b4ea2-4ee2-4c0a-ba8a-96f0ffefca4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e9762da2-7517-4979-be6a-d6278bb92020 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:50 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 1 in 0.796s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Temporary image b7dd9528-99cd-419a-b4c5-57b3f4778cde is fetched for user 40afa672e3ba49adb13ef4d92135ed37. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d65d2a9-4963-49fe-9214-f44dbda4d55f]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:50 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:50 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:51 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c 1073741824" returned: 0 in 0.963s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:51 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c
Jul 07 03:54:51 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:51 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:51 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:51 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:51 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.554s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2041832457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55326773-7cd7-482e-a82d-8abaf9501caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621f5cd0c1ca44e4a53d4ab5e4c8061d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:46Z,use_quota=True,user_id='e54ae27ef15c43df83a136cba6160aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Creating volume 55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:51 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c740bf38-d07a-487c-8843-408638b1eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0364822-f4ea-4874-9057-da619615ea5c', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7588808b-d7db-44e3-9668-836f7fb45346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:51 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf 1073741824
Jul 07 03:54:51 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:51 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Volume volume-a0364822-f4ea-4874-9057-da619615ea5c (a0364822-f4ea-4874-9057-da619615ea5c): created successfully
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7588808b-d7db-44e3-9668-836f7fb45346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:51 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Flow 'volume_create_manager' (69fda23a-043b-428c-80c3-bb2bcbe94511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:51 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5ffef283-6cf7-4248-a7ce-c9e5ac94375c tempest-CreateVolumesFromSnapshotTest-5695848 None] Created volume successfully.
Jul 07 03:54:52 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 1 in 0.795s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-a0364822-f4ea-4874-9057-da619615ea5c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-a0364822-f4ea-4874-9057-da619615ea5c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-a0364822-f4ea-4874-9057-da619615ea5c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-a0364822-f4ea-4874-9057-da619615ea5c" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be18623-a520-4fab-b224-814865b7bdd0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:52 devstack sudo[105050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c
Jul 07 03:54:52 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:52 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf 1073741824" returned: 0 in 0.998s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:52 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:54:52 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:53 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c" returned: 0 in 0.800s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:53 devstack sudo[105060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c
Jul 07 03:54:53 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:53 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 0.675s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3631b0-d3c6-4d01-a926-3b8b5ae11747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7daff15478bc4f8a94336f329002c56c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:54:48Z,use_quota=True,user_id='40afa672e3ba49adb13ef4d92135ed37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Creating volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:54:53 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab5513-d254-4a37-91b3-9448b015fd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55326773-7cd7-482e-a82d-8abaf9501caf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4324c470-fbaf-49ca-beda-a899e1f953ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:54:53 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1073741824
Jul 07 03:54:53 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:53 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Volume volume-55326773-7cd7-482e-a82d-8abaf9501caf (55326773-7cd7-482e-a82d-8abaf9501caf): created successfully
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4324c470-fbaf-49ca-beda-a899e1f953ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:54:53 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Flow 'volume_create_manager' (51b4a298-e011-4ce6-8eb3-4b9cd6de779a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:54:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e3942538-dd0a-4884-9caa-fe22f5dc8941 tempest-VolumeDependencyTests-65458445 None] Created volume successfully.
Jul 07 03:54:54 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-a0364822-f4ea-4874-9057-da619615ea5c" returned: 0 in 0.725s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-a0364822-f4ea-4874-9057-da619615ea5c" released by "delete_volume" :: held 1.576s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['960d22f8-409a-4f99-af72-c17f86730e2e', 'afb70d8c-8598-42a7-a235-10167fd7c0ab', '153b7c47-9a2c-438e-9767-7894847aa072', 'c0c9a49f-a6f0-4f2b-934d-881648734311'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:54 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:54 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:54 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1073741824" returned: 0 in 0.870s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:54 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:54:54 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-ff70a787-30b4-4c33-8106-29af0ac4120c-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-ff70a787-30b4-4c33-8106-29af0ac4120c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-ff70a787-30b4-4c33-8106-29af0ac4120c" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-ff70a787-30b4-4c33-8106-29af0ac4120c" acquired by "delete_volume" :: waited 0.038s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a24a3d-1b93-44f7-8d60-2a0906ab415f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:55 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:55 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b726227e-c506-43af-9cf6-034b0891634a tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-a0364822-f4ea-4874-9057-da619615ea5c-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:55 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c
Jul 07 03:54:55 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:55 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 0 in 0.749s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.386s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Creating offline snapshot 745d5d51-a7e1-4790-8272-6d492f3d520c of volume 55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34f4c26-1e69-474a-ba27-3bd9a8073e68]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Attempting download of b7dd9528-99cd-419a-b4c5-57b3f4778cde ((None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}])) to volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f403dee-b084-418f-8fb5-33383d7418da]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:55 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:54:55 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:55 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4
Jul 07 03:54:55 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:55 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c" returned: 0 in 0.938s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:55 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c
Jul 07 03:54:55 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:56 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 0.992s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:56 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4" returned: 0 in 0.918s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:56 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c 1G
Jul 07 03:54:56 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:56 devstack sudo[105099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4
Jul 07 03:54:56 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:56 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-ff70a787-30b4-4c33-8106-29af0ac4120c" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-ff70a787-30b4-4c33-8106-29af0ac4120c" released by "delete_volume" :: held 1.739s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['4c30c760-6e37-49ee-b7d5-e0498088cbb9', '7ff9e926-60fc-41d1-9b49-923317b2f837', 'f902ff8c-bd4d-4c07-92a0-192c12cd5788', '0c1122f8-5118-4c66-b3c1-a4f55a652bd9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:56 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:56 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-32b91370-352e-48cb-91c1-c253f3627037-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:57 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4" returned: 1 in 0.810s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7dd9528-99cd-419a-b4c5-57b3f4778cde_f9448iw4' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-32b91370-352e-48cb-91c1-c253f3627037-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[065db1b5-e0a3-4c9d-9679-c0c0476fc015]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-32b91370-352e-48cb-91c1-c253f3627037" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-32b91370-352e-48cb-91c1-c253f3627037" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:57 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c 1G" returned: 0 in 0.977s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55326773-7cd7-482e-a82d-8abaf9501caf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:57 devstack sudo[105111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:57 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5339756-b742-4854-92f9-2c9344e3c98d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:57 devstack sudo[105113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55326773-7cd7-482e-a82d-8abaf9501caf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:54:57 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:57 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037
Jul 07 03:54:57 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:57 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.949s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:54:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:54:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5f52dc58-74e8-4044-8a74-752a51a82481 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-ff70a787-30b4-4c33-8106-29af0ac4120c-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:58 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 0 in 1.026s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:58 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55326773-7cd7-482e-a82d-8abaf9501caf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.970s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:58 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c is being set with open permissions: ugo+rw
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:58 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:54:58 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:58 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037" returned: 0 in 1.037s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:58 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD
Jul 07 03:54:58 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:58 devstack sudo[105129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037
Jul 07 03:54:58 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:58 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.682s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:59 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD" returned: 1 in 0.823s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] b7dd9528-99cd-419a-b4c5-57b3f4778cde was raw, converting to raw {{(pid=86955) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 03:54:59 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info
Jul 07 03:54:59 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:59 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:54:59 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:59 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-32b91370-352e-48cb-91c1-c253f3627037" returned: 0 in 0.715s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-32b91370-352e-48cb-91c1-c253f3627037" released by "delete_volume" :: held 1.815s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['4195cae7-4e60-4b87-bf7e-7469ec62400e', '00179df8-2ea9-4cba-9c34-6922c576960e', 'f665fca9-395b-4191-8bf7-dfa32c9b0914', '54210ddd-8799-4b33-b389-27a67b8c9e1f'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:59 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:54:59 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" acquired by "delete_volume" :: waited 0.036s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[106d385a-4862-4172-9714-31fd172d3361]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:59 devstack sudo[105145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf
Jul 07 03:54:59 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:54:59 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info" returned: 0 in 0.848s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:54:59 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info is being set with open permissions: ugo+rw
Jul 07 03:54:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:54:59 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info
Jul 07 03:54:59 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:00 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 0 in 1.030s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7dd9528-99cd-419a-b4c5-57b3f4778cde_yp2hmqyvdevstack@QuobyteHD, size 0.00 MB, duration 1.03 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:55:00 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:00 devstack sudo[105153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1G
Jul 07 03:55:00 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:00 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.955s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7e0b45ed-2be3-46bf-af09-b73dfca4c653 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-32b91370-352e-48cb-91c1-c253f3627037-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:00 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" returned: 0 in 0.966s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:00 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf
Jul 07 03:55:00 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:00 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.info" returned: 0 in 0.867s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.440s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ed3899be-574e-423e-99c6-53cc54b14635 tempest-VolumeDependencyTests-65458445 None] Create snapshot completed successfully
Jul 07 03:55:00 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 1G" returned: 0 in 0.874s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4831016d-e759-4f7d-855f-296363eea046]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:01 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:55:01 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:01 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" returned: 0 in 0.759s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf" released by "delete_volume" :: held 1.798s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=158,cinder:UPDATE=223,cinder:DELETE=24,cinder:INSERT=49 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['e3badbb8-24d5-49b7-8433-d38b9ad5892e', 'e0053423-ebc0-4c7c-a86f-6fb8c445c27f', 'a39a3b0e-5089-47c1-9bcb-25977c9cfddf', '3b88ade4-407e-4f6f-b919-af3c35a0c14d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:01 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:01 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=155,cinder:UPDATE=213,cinder:INSERT=63,cinder:DELETE=17 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-6378d18c-7f99-468f-a7e8-4f7b3281eb24-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Flow 'volume_create_manager' (85aebed9-2c6b-4c92-a878-c33e7a792c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9877a2fd-0ce0-4915-9f72-7ce5b0e479b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-6378d18c-7f99-468f-a7e8-4f7b3281eb24-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9877a2fd-0ce0-4915-9f72-7ce5b0e479b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1919658063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc27b70-7390-4474-9a7f-5430040999ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621f5cd0c1ca44e4a53d4ab5e4c8061d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=745d5d51-a7e1-4790-8272-6d492f3d520c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:02Z,use_quota=True,user_id='e54ae27ef15c43df83a136cba6160aad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13059fbc-45b9-46f2-ae3d-e81f949bc6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13059fbc-45b9-46f2-ae3d-e81f949bc6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be5c0d-b2a2-40f8-9b94-10e02c361410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37be5c0d-b2a2-40f8-9b94-10e02c361410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4dc27b70-7390-4474-9a7f-5430040999ea', 'volume_name': 'volume-4dc27b70-7390-4474-9a7f-5430040999ea', 'volume_size': 1, 'snapshot_id': '745d5d51-a7e1-4790-8272-6d492f3d520c'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b90310-52c3-4cb6-aec3-f88d9d2c51f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b90310-52c3-4cb6-aec3-f88d9d2c51f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21f8573-e975-44ee-bc3b-f2a09801bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Volume 4dc27b70-7390-4474-9a7f-5430040999ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4dc27b70-7390-4474-9a7f-5430040999ea', 'volume_size': 1, 'snapshot_id': '745d5d51-a7e1-4790-8272-6d492f3d520c'}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c-4dc27b70-7390-4474-9a7f-5430040999ea" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:02 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 0 in 1.101s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c-4dc27b70-7390-4474-9a7f-5430040999ea" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Creating volume 4dc27b70-7390-4474-9a7f-5430040999ea from snapshot 745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-6378d18c-7f99-468f-a7e8-4f7b3281eb24" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] snapshot: 745d5d51-a7e1-4790-8272-6d492f3d520c, volume: 4dc27b70-7390-4474-9a7f-5430040999ea,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-6378d18c-7f99-468f-a7e8-4f7b3281eb24" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eddc0cb-f48d-4d4e-ac59-c5a07c6f42fe]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[428bb048-5956-4414-8759-dd5bfc61f5e6]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:02 devstack sudo[105174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:55:02 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:02 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24
Jul 07 03:55:02 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:02 devstack sudo[105177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:55:02 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:02 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.107s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:55:02 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e7dfae17-ac9e-4ce0-8d10-88298e2e780e tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-b353fc1c-57f3-4bb3-a5a2-bf7145ac4daf-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:03 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 1 in 1.095s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Downloaded image b7dd9528-99cd-419a-b4c5-57b3f4778cde ((None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}])) to volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747 successfully. {{(pid=86955) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Temporary image b7dd9528-99cd-419a-b4c5-57b3f4778cde for user 40afa672e3ba49adb13ef4d92135ed37 is deleted. {{(pid=86955) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.volume_utils [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Marking volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747 as bootable. {{(pid=86955) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Copying metadata from image b7dd9528-99cd-419a-b4c5-57b3f4778cde to 8d3631b0-d3c6-4d01-a926-3b8b5ae11747. {{(pid=86955) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Creating volume glance metadata for volume 8d3631b0-d3c6-4d01-a926-3b8b5ae11747 backed by image b7dd9528-99cd-419a-b4c5-57b3f4778cde with: {'image_id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9c95a0a9d1a703a88ef4e88ba3c3ba83', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86955) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 03:55:03 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.984s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55326773-7cd7-482e-a82d-8abaf9501caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ccef18-a652-4741-bfe8-da62a302b742]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:03 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24" returned: 0 in 1.055s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:03 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24
Jul 07 03:55:03 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d76998-7817-4aa5-a418-04a29399f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747', 'volume_size': 1, 'image_id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c95a0a9d1a703a88ef4e88ba3c3ba83', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7daff15478bc4f8a94336f329002c56c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35c3c2f831b354a7070cb59c996d90b0df72d7a16c76b20cfbe6e31f2654f32f913fccb83e6a4a4bf8ccbff9c70990fdad02dec97fa0e8c8f51630adb4560774', 'id': 'b7dd9528-99cd-419a-b4c5-57b3f4778cde', 'created_at': datetime.datetime(2026, 7, 7, 1, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 1, 54, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7dd9528-99cd-419a-b4c5-57b3f4778cde/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x738b44cd4e90>}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fc979-62ae-4d2d-a153-5607190442df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:03 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Volume volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 (8d3631b0-d3c6-4d01-a926-3b8b5ae11747): created successfully
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fc979-62ae-4d2d-a153-5607190442df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Flow 'volume_create_manager' (5a919fc9-3755-42bf-b7e7-dffb8507f935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:03 devstack sudo[105191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:55:03 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:03 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4395f067-e970-48a9-a564-5a029a84c119 tempest-VolumeImageDependencyTests-179066606 None] Created volume successfully.
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Acquiring lock "cinder-8d3631b0-d3c6-4d01-a926-3b8b5ae11747-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "cinder-8d3631b0-d3c6-4d01-a926-3b8b5ae11747-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Acquiring lock "cinder-quobyte-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:03 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "cinder-quobyte-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a0156-bdda-4b25-9f14-f9dbadfbb6d3]: (4, 'raw') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:04 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:55:04 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:04 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-6378d18c-7f99-468f-a7e8-4f7b3281eb24" returned: 0 in 1.064s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-6378d18c-7f99-468f-a7e8-4f7b3281eb24" released by "delete_volume" :: held 2.215s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:04 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 1.145s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:04 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea
Jul 07 03:55:04 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['0dbe3aba-659a-4595-83e6-411f7f0b871e', '2f8f197c-dd6b-4534-9ee4-7ac41d6857a1', '7ecdb47f-5294-485a-aa4f-b1967d7dc51d', 'b61e8f61-6dc8-4f5e-9898-a48e3830b198'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:04 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:04 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:05 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 0 in 1.113s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:05 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:55:05 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:05 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.847s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:05 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-60d8b9e4-c134-439a-9ce2-bc66d426dc86 tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-6378d18c-7f99-468f-a7e8-4f7b3281eb24-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleting offline snapshot fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 of volume aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] snapshot_file for this snap is: volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccead6b-7350-4fe6-8bed-06c343fe00ac]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:06 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0
Jul 07 03:55:06 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:06 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 1 in 1.683s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747' failed. Not Retrying. {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 03:55:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:06 devstack sudo[105554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747
Jul 07 03:55:06 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:08 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" returned: 0 in 2.351s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49e1a6-1bb0-41e6-8067-711016e48839]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:08 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" returned: 0 in 1.397s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "cinder-quobyte-8d3631b0-d3c6-4d01-a926-3b8b5ae11747" released by "delete_volume" :: held 4.347s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Created reservations ['5d2115da-3e98-4d8f-bf4f-b48e0c0c68aa', '933e395f-6e5f-4e6e-879a-054147125cad', 'b9ca855d-771b-4ad8-ac23-355c129c0ce4', 'e3b26bc8-c943-4324-956a-a17be171bdce'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:08 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1
Jul 07 03:55:08 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:08 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:08 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:09 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.302s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:09 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:09 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Deleted volume successfully.
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-cf44022d-b0f4-4a90-86b7-19ea8ea9153c tempest-VolumeImageDependencyTests-179066606 None] Lock "cinder-8d3631b0-d3c6-4d01-a926-3b8b5ae11747-delete_volume" released by "delete_volume" :: held 6.172s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:10 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1" returned: 0 in 2.398s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:10 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0
Jul 07 03:55:10 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:10 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea" returned: 0 in 6.415s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[b447cfba-4eed-41e8-8881-0e8bde2b09b8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:11 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:55:11 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:11 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" returned: 0 in 1.214s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:11 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0
Jul 07 03:55:11 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:12 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 1.410s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf, size 1024.00 MB, duration 6.42 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:55:12 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Converted 1024.00 MB image at 159.60 MB/s
Jul 07 03:55:12 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea is being set with open permissions: ugo+rw
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:12 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea
Jul 07 03:55:12 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:12 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1.fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" returned: 0 in 0.868s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0" released by "_delete_snapshot" :: held 7.056s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" released by "delete_snapshot" :: held 7.118s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['c6c9dd3d-7fe8-4662-9319-97029b02ddf5', '1017d2ae-67d1-4f97-b84e-40d899d93a86', 'bafbd79f-9f78-46f4-bf68-9d4212cc64a5', '3229ecf9-d8e9-4428-afd5-f5bcd3680086'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Delete snapshot completed successfully.
Jul 07 03:55:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-34e2724b-4e9e-4fec-8ebc-f3aa5bed611c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-fa39c59d-e684-4f8f-826f-e4a16f7a7ad0-delete_snapshot" released by "delete_snapshot" :: held 7.371s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:13 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea" returned: 0 in 0.806s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" released by "_copy_volume_from_snapshot" :: held 10.914s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c-4dc27b70-7390-4474-9a7f-5430040999ea" released by "_create_volume_from_snapshot" :: held 10.965s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d21f8573-e975-44ee-bc3b-f2a09801bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc27b70-7390-4474-9a7f-5430040999ea', 'volume_size': 1, 'snapshot_id': '745d5d51-a7e1-4790-8272-6d492f3d520c'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bee2dfa-d67f-417e-a944-8dc170be873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:13 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Volume volume-4dc27b70-7390-4474-9a7f-5430040999ea (4dc27b70-7390-4474-9a7f-5430040999ea): created successfully
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bee2dfa-d67f-417e-a944-8dc170be873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Flow 'volume_create_manager' (85aebed9-2c6b-4c92-a878-c33e7a792c2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-f18cf494-8880-4dc6-b307-79c168a58bab tempest-VolumeDependencyTests-65458445 None] Created volume successfully.
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-aa114ba9-efc5-4610-935e-9cf3b892f3e1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-aa114ba9-efc5-4610-935e-9cf3b892f3e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[615d8386-2978-4558-9d73-46dab484f626]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:13 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1
Jul 07 03:55:13 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:14 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1" returned: 0 in 0.786s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:14 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1
Jul 07 03:55:14 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-745d5d51-a7e1-4790-8272-6d492f3d520c-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-745d5d51-a7e1-4790-8272-6d492f3d520c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Deleting offline snapshot 745d5d51-a7e1-4790-8272-6d492f3d520c of volume 55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] snapshot_file for this snap is: volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8667953-fbf7-445f-953a-8c7a596bc1ad]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:14 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:55:14 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:14 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-aa114ba9-efc5-4610-935e-9cf3b892f3e1" returned: 0 in 0.832s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-quobyte-aa114ba9-efc5-4610-935e-9cf3b892f3e1" released by "delete_volume" :: held 1.693s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Created reservations ['cedca6d4-062e-4c42-8741-993bab54bb38', '2b455cc1-5260-4d10-a94f-79a68b3b9e59', 'b030ce92-0fc9-4bd4-9bfc-6b402ab99613', '8a09f18d-1179-4877-929b-a4ed5efb69ed'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:15 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:15 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:15 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.866s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55326773-7cd7-482e-a82d-8abaf9501caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[634efa19-702c-42ad-96cb-e73b47376ee4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:15 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:15 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:15 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:55:15 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:15 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.812s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (e4e8acbd-3efb-4be2-b401-8bf8db3bc190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaa1975-bf91-4866-a4ac-f35fcc95ef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Deleted volume successfully.
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aaa1975-bf91-4866-a4ac-f35fcc95ef76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653787181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127b13be-50a0-43cd-af2d-960ee522057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:16Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc25f1b-767a-46ec-af0a-d80036004aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc25f1b-767a-46ec-af0a-d80036004aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de52ba28-706f-4a18-933b-49cf8edfed00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de52ba28-706f-4a18-933b-49cf8edfed00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '127b13be-50a0-43cd-af2d-960ee522057a', 'volume_name': 'volume-127b13be-50a0-43cd-af2d-960ee522057a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0257a4fe-07a3-4473-9eb5-81ca16a84a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0257a4fe-07a3-4473-9eb5-81ca16a84a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43aa04d-b083-407a-9b3b-633533716309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Volume 127b13be-50a0-43cd-af2d-960ee522057a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-127b13be-50a0-43cd-af2d-960ee522057a', 'volume_size': 1}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653787181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127b13be-50a0-43cd-af2d-960ee522057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:16Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Creating volume 127b13be-50a0-43cd-af2d-960ee522057a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:16 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3d32262b-8088-4a24-9d79-affe97d1f85c tempest-CreateVolumesFromSnapshotTest-5695848 None] Lock "cinder-aa114ba9-efc5-4610-935e-9cf3b892f3e1-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:16 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a 1073741824
Jul 07 03:55:16 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:16 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.997s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:55:16 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 1.205s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:16 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:55:16 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:17 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a 1073741824" returned: 0 in 1.013s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:17 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a
Jul 07 03:55:17 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:17 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.916s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:17 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c
Jul 07 03:55:17 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:18 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a" returned: 0 in 0.894s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43aa04d-b083-407a-9b3b-633533716309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127b13be-50a0-43cd-af2d-960ee522057a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013de17c-630b-495e-b87f-5742c175e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:18 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Volume volume-127b13be-50a0-43cd-af2d-960ee522057a (127b13be-50a0-43cd-af2d-960ee522057a): created successfully
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (013de17c-630b-495e-b87f-5742c175e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (e4e8acbd-3efb-4be2-b401-8bf8db3bc190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-4616fde8-0317-4afd-a30b-e65d128d59e4 tempest-ProjectReaderTests-1578117559 None] Created volume successfully.
Jul 07 03:55:18 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf.745d5d51-a7e1-4790-8272-6d492f3d520c" returned: 0 in 0.844s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-745d5d51-a7e1-4790-8272-6d492f3d520c" released by "_delete_snapshot" :: held 3.985s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" released by "delete_snapshot" :: held 4.017s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Created reservations ['6637b0b6-af97-4874-994f-a27831810c0d', '9fef8a29-a717-42ab-834b-3ee533a055c7', 'd338633e-b694-4681-ab67-88c67da31f25', 'ba910e08-9b57-421e-a5cd-42c1d59b4b16'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Delete snapshot completed successfully.
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c8fbad93-1ff3-4fff-b2c6-f976337b80b2 tempest-VolumeDependencyTests-65458445 None] Lock "cinder-745d5d51-a7e1-4790-8272-6d492f3d520c-delete_snapshot" released by "delete_snapshot" :: held 4.188s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-55326773-7cd7-482e-a82d-8abaf9501caf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "cinder-55326773-7cd7-482e-a82d-8abaf9501caf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01420c7-f56b-44fe-8c74-c59fc3f0ff9a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:18 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:55:18 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-127b13be-50a0-43cd-af2d-960ee522057a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-127b13be-50a0-43cd-af2d-960ee522057a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-quobyte-127b13be-50a0-43cd-af2d-960ee522057a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-127b13be-50a0-43cd-af2d-960ee522057a" acquired by "delete_volume" :: waited 0.030s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a91543-f527-4ac0-8028-6b6ce4d54316]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:19 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 0.913s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:19 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a
Jul 07 03:55:19 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf
Jul 07 03:55:19 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:19 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:20 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-55326773-7cd7-482e-a82d-8abaf9501caf" returned: 0 in 0.699s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-55326773-7cd7-482e-a82d-8abaf9501caf" released by "delete_volume" :: held 1.671s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Created reservations ['efb46c24-024b-4744-8bd0-160dbf7df7c3', 'd5f8abc0-5f0e-4076-9ae5-aa9f5b491ec2', '78d32b13-a49e-46a5-8e1c-c1e1f390ccb1', '41ae9949-3a0e-4cfd-b07a-d0e1d812c9b3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:20 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a" returned: 0 in 0.963s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:20 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:20 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:20 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a
Jul 07 03:55:20 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:20 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5e9cad0a-8f25-4910-89af-f29223676c1a tempest-ProjectAdminTests-672224447 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86955) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-4dc27b70-7390-4474-9a7f-5430040999ea-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "cinder-4dc27b70-7390-4474-9a7f-5430040999ea-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Acquiring lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" acquired by "delete_volume" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa345b0-ff48-4be1-beec-4dd37683af00]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:21 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea
Jul 07 03:55:21 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:21 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:21 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Deleted volume successfully.
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-515656cc-9aa3-4369-9b38-ec68e80e332f tempest-VolumeDependencyTests-65458445 None] Lock "cinder-55326773-7cd7-482e-a82d-8abaf9501caf-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:21 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-127b13be-50a0-43cd-af2d-960ee522057a" returned: 0 in 0.892s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-127b13be-50a0-43cd-af2d-960ee522057a" released by "delete_volume" :: held 1.917s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Created reservations ['b32c8416-2674-461f-9c6a-a191856e7a55', '41799b52-09b8-48f6-a2eb-72791f03573a', 'beeffe40-51e3-40cd-a334-0831214340ff', 'e951e1ec-dab6-4969-8c82-a72a0636f2d7'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:21 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:21 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:22 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea" returned: 0 in 1.045s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:22 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea
Jul 07 03:55:22 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (286cce5d-5b3c-4d45-b94e-d030fa2f7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2c6820-35dd-4923-acdf-87a08da433c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2c6820-35dd-4923-acdf-87a08da433c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154626205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f9a1d3-c1ef-4372-b45f-32cd603814c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:22Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4618cb5d-42f6-473a-b581-a53745f3f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4618cb5d-42f6-473a-b581-a53745f3f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e226261a-53e0-40d1-933f-a901dbbd04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:22 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e226261a-53e0-40d1-933f-a901dbbd04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f9a1d3-c1ef-4372-b45f-32cd603814c0', 'volume_name': 'volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32aa4e83-d25c-462c-945b-b4789032d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32aa4e83-d25c-462c-945b-b4789032d842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbffd83-abf0-490e-990f-bac85f70c2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:22 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Volume 91f9a1d3-c1ef-4372-b45f-32cd603814c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0', 'volume_size': 1}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-154626205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f9a1d3-c1ef-4372-b45f-32cd603814c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:22Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Creating volume 91f9a1d3-c1ef-4372-b45f-32cd603814c0 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:22 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 1.006s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Deleted volume successfully.
Jul 07 03:55:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e4488d40-d49b-44ed-87d7-cc4ce8ae05c6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-127b13be-50a0-43cd-af2d-960ee522057a-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:22 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 1073741824
Jul 07 03:55:22 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:23 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4dc27b70-7390-4474-9a7f-5430040999ea" returned: 0 in 0.975s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "cinder-quobyte-4dc27b70-7390-4474-9a7f-5430040999ea" released by "delete_volume" :: held 2.122s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Created reservations ['b36bffa4-b470-41a4-9966-9c375148c005', 'cb820546-78f9-4f73-bbc7-9075f37d7fc7', '994b5355-f964-463f-8813-7e90f619809e', '6d58e594-8713-4777-a8e9-1c6e7ff34517'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:23 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:23 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:23 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 1073741824" returned: 0 in 1.168s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:23 devstack sudo[105675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0
Jul 07 03:55:23 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:24 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Deleted volume successfully.
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a37034e8-445b-46f9-a0c8-fbb5d641b24d tempest-VolumeDependencyTests-65458445 None] Lock "cinder-4dc27b70-7390-4474-9a7f-5430040999ea-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:24 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0" returned: 0 in 0.941s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] <== create_volume: return (2165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbffd83-abf0-490e-990f-bac85f70c2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5fe5ab-6937-4bea-9963-ec58a5659f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:24 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Volume volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 (91f9a1d3-c1ef-4372-b45f-32cd603814c0): created successfully
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5fe5ab-6937-4bea-9963-ec58a5659f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:24 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (286cce5d-5b3c-4d45-b94e-d030fa2f7426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2c237f2a-d048-4842-8bc0-64855d6b5bb3 tempest-ProjectReaderTests-1578117559 None] Created volume successfully.
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-91f9a1d3-c1ef-4372-b45f-32cd603814c0-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-91f9a1d3-c1ef-4372-b45f-32cd603814c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-quobyte-91f9a1d3-c1ef-4372-b45f-32cd603814c0" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-91f9a1d3-c1ef-4372-b45f-32cd603814c0" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf08739-2663-46ab-bf2e-bd44abcbc017]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:25 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0
Jul 07 03:55:25 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Flow 'volume_create_manager' (ae390329-9542-428c-b518-889a9298f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d855e39-4095-46a0-8b32-f0b9c0474baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d855e39-4095-46a0-8b32-f0b9c0474baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637887312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df00784-5c3f-4e6d-aced-a423d7cdf70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85070124861d4eb38352cda0be4ac040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:26Z,use_quota=True,user_id='c815a513db6540b290d29e34cdb7225d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ef177-6f76-430c-8da5-68245fc8b1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ef177-6f76-430c-8da5-68245fc8b1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d0581-7699-4458-84b7-f5d18d23119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d0581-7699-4458-84b7-f5d18d23119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df00784-5c3f-4e6d-aced-a423d7cdf70d', 'volume_name': 'volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32707388-a4e5-4f47-a655-0d7fc520c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32707388-a4e5-4f47-a655-0d7fc520c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cd5860-dfcd-4e88-8382-bd3e4418f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:26 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Volume 4df00784-5c3f-4e6d-aced-a423d7cdf70d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d', 'volume_size': 1}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637887312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df00784-5c3f-4e6d-aced-a423d7cdf70d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85070124861d4eb38352cda0be4ac040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:26Z,use_quota=True,user_id='c815a513db6540b290d29e34cdb7225d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Creating volume 4df00784-5c3f-4e6d-aced-a423d7cdf70d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:26 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:26 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d 1073741824
Jul 07 03:55:26 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:26 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0" returned: 0 in 0.815s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:26 devstack sudo[105687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0
Jul 07 03:55:26 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:27 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-91f9a1d3-c1ef-4372-b45f-32cd603814c0" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-91f9a1d3-c1ef-4372-b45f-32cd603814c0" released by "delete_volume" :: held 1.525s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:27 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d 1073741824" returned: 0 in 0.929s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Created reservations ['0bd6bd1a-53e8-4786-87f7-fdf9eaeeccd6', 'e190dc2f-0e77-460c-af39-2e7a8326f41a', 'a3778d63-7b7a-4abe-b535-08c49030b2cd', '45d09d89-1e8f-4f12-aa1e-070b84685c53'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:27 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d
Jul 07 03:55:27 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:27 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:27 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:28 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d" returned: 0 in 0.694s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cd5860-dfcd-4e88-8382-bd3e4418f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d81157-6be2-41ae-8319-945c16f98f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Volume volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d (4df00784-5c3f-4e6d-aced-a423d7cdf70d): created successfully
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45d81157-6be2-41ae-8319-945c16f98f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Flow 'volume_create_manager' (ae390329-9542-428c-b518-889a9298f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Deleted volume successfully.
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e46064eb-067d-437c-b3e1-8d3d5a35be03 tempest-ProjectReaderTests-825475428 None] Created volume successfully.
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39b1b3f8-0f6a-4efa-80dd-465d0d97d407 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-91f9a1d3-c1ef-4372-b45f-32cd603814c0-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (525f7a16-986f-4904-92dd-ccceb70f188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d41b911-3e67-43a6-9237-b02299829694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d41b911-3e67-43a6-9237-b02299829694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694737574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abeb573-753f-4a3a-ae25-587b8e1dc045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:28Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d34557b-82c7-4f8d-bb1c-4cd7545f2dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d34557b-82c7-4f8d-bb1c-4cd7545f2dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337eb157-c3b1-41ae-9170-5a9924101841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337eb157-c3b1-41ae-9170-5a9924101841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abeb573-753f-4a3a-ae25-587b8e1dc045', 'volume_name': 'volume-1abeb573-753f-4a3a-ae25-587b8e1dc045', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f22278-e15a-43ce-bed2-159e9b98be48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f22278-e15a-43ce-bed2-159e9b98be48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd078dba-540d-466a-887c-9289c21c7026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Volume 1abeb573-753f-4a3a-ae25-587b8e1dc045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abeb573-753f-4a3a-ae25-587b8e1dc045', 'volume_size': 1}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694737574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abeb573-753f-4a3a-ae25-587b8e1dc045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:28Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Creating volume 1abeb573-753f-4a3a-ae25-587b8e1dc045 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:28 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 1073741824
Jul 07 03:55:28 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Acquiring lock "cinder-4df00784-5c3f-4e6d-aced-a423d7cdf70d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "cinder-4df00784-5c3f-4e6d-aced-a423d7cdf70d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Acquiring lock "cinder-quobyte-4df00784-5c3f-4e6d-aced-a423d7cdf70d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "cinder-quobyte-4df00784-5c3f-4e6d-aced-a423d7cdf70d" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[88374f43-2515-47a9-801f-d963a53009fe]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (6dc63a10-4196-42f1-b0f3-e4a09a6932c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759d589d-f961-4cb7-b37e-45c8d95779b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (759d589d-f961-4cb7-b37e-45c8d95779b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738741688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd94ad9-9626-4eba-abb1-c401ff332f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:29Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42de27af-5370-4eff-b488-637add56c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42de27af-5370-4eff-b488-637add56c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1211a48d-6bcd-434d-ad83-36bfab6accb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1211a48d-6bcd-434d-ad83-36bfab6accb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd94ad9-9626-4eba-abb1-c401ff332f54', 'volume_name': 'volume-bfd94ad9-9626-4eba-abb1-c401ff332f54', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b07f35-6a66-410b-8a0f-83b25cd1183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b07f35-6a66-410b-8a0f-83b25cd1183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad28ff80-d3a9-4b34-94de-ce684b21f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Volume bfd94ad9-9626-4eba-abb1-c401ff332f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd94ad9-9626-4eba-abb1-c401ff332f54', 'volume_size': 1}
Jul 07 03:55:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:28 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d
Jul 07 03:55:28 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:29 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 1073741824" returned: 0 in 0.921s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:29 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045
Jul 07 03:55:29 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:29 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d" returned: 0 in 0.799s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:29 devstack sudo[105713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d
Jul 07 03:55:29 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:30 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738741688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd94ad9-9626-4eba-abb1-c401ff332f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:29Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Creating volume bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:30 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd078dba-540d-466a-887c-9289c21c7026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abeb573-753f-4a3a-ae25-587b8e1dc045', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:30 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 1073741824
Jul 07 03:55:30 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c021f1-af1a-4e4c-965a-4c37ef5fb092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:30 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Volume volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 (1abeb573-753f-4a3a-ae25-587b8e1dc045): created successfully
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c021f1-af1a-4e4c-965a-4c37ef5fb092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (525f7a16-986f-4904-92dd-ccceb70f188f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:30 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-49be40ab-266b-4937-a714-5471731f439d tempest-ProjectReaderTests-1578117559 None] Created volume successfully.
Jul 07 03:55:30 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4df00784-5c3f-4e6d-aced-a423d7cdf70d" returned: 0 in 0.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "cinder-quobyte-4df00784-5c3f-4e6d-aced-a423d7cdf70d" released by "delete_volume" :: held 1.511s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Created reservations ['ccdfbcd7-0b23-47a0-8165-e41ea2cfd0a4', '4e976e62-0504-463f-9717-6edd35dab970', 'ef13c78d-92c4-49ed-9818-16c0027693a8', '6abc3a44-95cc-438d-a6f9-64a56ff066ed'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:30 devstack sudo[105719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:30 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-1abeb573-753f-4a3a-ae25-587b8e1dc045-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-1abeb573-753f-4a3a-ae25-587b8e1dc045-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-quobyte-1abeb573-753f-4a3a-ae25-587b8e1dc045" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-1abeb573-753f-4a3a-ae25-587b8e1dc045" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c402d4-a859-44be-a127-1e9c4ccc5b5e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:30 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045
Jul 07 03:55:30 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:31 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Deleted volume successfully.
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-0dc7b9eb-c353-4451-bfad-4f61c4fc0047 tempest-ProjectReaderTests-825475428 None] Lock "cinder-4df00784-5c3f-4e6d-aced-a423d7cdf70d-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:31 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 1073741824" returned: 0 in 1.004s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:31 devstack sudo[105728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54
Jul 07 03:55:31 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Flow 'volume_create_manager' (4aeff2ab-b56c-4428-9a37-af4191923fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e3841d-1c06-41be-bca0-40e7eb43fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e3841d-1c06-41be-bca0-40e7eb43fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318912368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d072171e-a9cc-41b2-b688-aecd644d3e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85070124861d4eb38352cda0be4ac040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:31Z,use_quota=True,user_id='c815a513db6540b290d29e34cdb7225d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5571d876-bb7e-48f8-9dff-d08173bd62f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5571d876-bb7e-48f8-9dff-d08173bd62f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e333ae0-6425-4175-8b46-33c5928221ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e333ae0-6425-4175-8b46-33c5928221ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd072171e-a9cc-41b2-b688-aecd644d3e91', 'volume_name': 'volume-d072171e-a9cc-41b2-b688-aecd644d3e91', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fa2d8c-dd78-4311-b68c-42743c1ba4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3fa2d8c-dd78-4311-b68c-42743c1ba4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f92b361-7bfc-4198-a6b8-4b620baed69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Volume d072171e-a9cc-41b2-b688-aecd644d3e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d072171e-a9cc-41b2-b688-aecd644d3e91', 'volume_size': 1}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:31 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045" returned: 0 in 0.917s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:31 devstack sudo[105733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045
Jul 07 03:55:31 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:31 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54" returned: 0 in 0.684s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318912368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d072171e-a9cc-41b2-b688-aecd644d3e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85070124861d4eb38352cda0be4ac040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:31Z,use_quota=True,user_id='c815a513db6540b290d29e34cdb7225d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Creating volume d072171e-a9cc-41b2-b688-aecd644d3e91 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:31 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad28ff80-d3a9-4b34-94de-ce684b21f11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd94ad9-9626-4eba-abb1-c401ff332f54', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack sudo[105736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 1073741824
Jul 07 03:55:31 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31781388-b3d3-45ef-8beb-a3ebf17206e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:31 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Volume volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 (bfd94ad9-9626-4eba-abb1-c401ff332f54): created successfully
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31781388-b3d3-45ef-8beb-a3ebf17206e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:31 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (6dc63a10-4196-42f1-b0f3-e4a09a6932c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-76f42484-9859-4b4a-833e-eb5ba07910d2 tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:55:32 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-1abeb573-753f-4a3a-ae25-587b8e1dc045" returned: 0 in 0.661s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-1abeb573-753f-4a3a-ae25-587b8e1dc045" released by "delete_volume" :: held 1.625s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Created reservations ['eaa2c233-8319-439f-82d6-05f843eee06c', '8c9eadb0-5be4-495e-b934-6762c23deb3e', 'b2125522-7618-4b7e-88de-f42ac94cddb1', 'd364fe07-3c5b-4ae6-b601-c1a3fdb1499e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:32 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:32 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:32 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 1073741824" returned: 0 in 0.856s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:32 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91
Jul 07 03:55:32 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:33 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.672s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Deleted volume successfully.
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bef40d10-c3ff-4631-842c-633f05b8dcd6 tempest-ProjectReaderTests-1578117559 None] Lock "cinder-1abeb573-753f-4a3a-ae25-587b8e1dc045-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (7b9884fe-0166-4510-9d2d-9bad169892df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e930fd-f7d3-46f7-a876-f87f0cf61786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61e930fd-f7d3-46f7-a876-f87f0cf61786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417949076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e53f3cf-e8fc-44f0-a0ed-974a82c7d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:33Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60906e29-ce0f-4e55-a625-1fbfab4c0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60906e29-ce0f-4e55-a625-1fbfab4c0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee212a-408a-4c7b-b2cb-35641cd5c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aee212a-408a-4c7b-b2cb-35641cd5c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e53f3cf-e8fc-44f0-a0ed-974a82c7d720', 'volume_name': 'volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f64d630-3bfb-48ff-80b3-ae1ac7116396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f64d630-3bfb-48ff-80b3-ae1ac7116396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff59b231-cff9-4a80-b338-09df551fd10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Volume 4e53f3cf-e8fc-44f0-a0ed-974a82c7d720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720', 'volume_size': 1}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:33 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91" returned: 0 in 0.742s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.112s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot efe5507e-fa5f-46b0-83eb-6d02a5b15ada of volume bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f92b361-7bfc-4198-a6b8-4b620baed69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d072171e-a9cc-41b2-b688-aecd644d3e91', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9ca610-1222-42fe-b293-b250e74c5750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14c6c6-07d2-4e58-892f-65621a614890]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:33 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Volume volume-d072171e-a9cc-41b2-b688-aecd644d3e91 (d072171e-a9cc-41b2-b688-aecd644d3e91): created successfully
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9ca610-1222-42fe-b293-b250e74c5750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:33 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Flow 'volume_create_manager' (4aeff2ab-b56c-4428-9a37-af4191923fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e20351e-eb19-46f9-aa8e-d6d010b5f6ec tempest-ProjectReaderTests-825475428 None] Created volume successfully.
Jul 07 03:55:33 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54
Jul 07 03:55:33 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:34 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54" returned: 0 in 0.782s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:34 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada 1G
Jul 07 03:55:34 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Acquiring lock "cinder-d072171e-a9cc-41b2-b688-aecd644d3e91-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "cinder-d072171e-a9cc-41b2-b688-aecd644d3e91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Acquiring lock "cinder-quobyte-d072171e-a9cc-41b2-b688-aecd644d3e91" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "cinder-quobyte-d072171e-a9cc-41b2-b688-aecd644d3e91" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba634cd-f317-4ae5-84f8-47943a1ca3a9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:34 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91
Jul 07 03:55:34 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:35 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada 1G" returned: 0 in 0.830s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:35 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada
Jul 07 03:55:35 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:35 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:35 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91
Jul 07 03:55:35 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:35 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:35 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada is being set with open permissions: ugo+rw
Jul 07 03:55:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:35 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada
Jul 07 03:55:35 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:36 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d072171e-a9cc-41b2-b688-aecd644d3e91" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "cinder-quobyte-d072171e-a9cc-41b2-b688-aecd644d3e91" released by "delete_volume" :: held 1.531s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Created reservations ['dcd6d6bc-d451-434f-b3ae-eda22f022a58', '01f768a8-cb4a-47c9-8875-9483152d8ca9', 'e843f3dc-c52f-458b-adc0-8ecef11a2bff', '403058fe-d247-4302-a0b3-83a09d1f1718'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:36 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:36 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:36 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada" returned: 0 in 0.707s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:36 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info
Jul 07 03:55:36 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:37 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.691s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:37 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Deleted volume successfully.
Jul 07 03:55:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-2b3507a7-be7f-4578-a281-f7ae3a43e8c7 tempest-ProjectReaderTests-825475428 None] Lock "cinder-d072171e-a9cc-41b2-b688-aecd644d3e91-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:37 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:37 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info is being set with open permissions: ugo+rw
Jul 07 03:55:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:37 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info
Jul 07 03:55:37 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:38 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.info" returned: 0 in 0.718s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.539s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417949076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e53f3cf-e8fc-44f0-a0ed-974a82c7d720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f50cf178bef4270a6eab3e30951bc26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:33Z,use_quota=True,user_id='c970c281d5764b7794c59b200731ab27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Creating volume 4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:38 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:38 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 1073741824
Jul 07 03:55:38 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:38 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a458489e-9aa5-4cf2-8fb3-11461330409b tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-efe5507e-fa5f-46b0-83eb-6d02a5b15ada-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-efe5507e-fa5f-46b0-83eb-6d02a5b15ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-efe5507e-fa5f-46b0-83eb-6d02a5b15ada" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-efe5507e-fa5f-46b0-83eb-6d02a5b15ada" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot efe5507e-fa5f-46b0-83eb-6d02a5b15ada of volume bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1631b9-62d2-46a1-a7c8-49b18146e606]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:38 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada
Jul 07 03:55:38 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:39 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 1073741824" returned: 0 in 0.922s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:39 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720
Jul 07 03:55:39 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:39 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada" returned: 0 in 0.786s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd94ad9-9626-4eba-abb1-c401ff332f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2039bf7-072c-488b-97a4-6bde251eaf47]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:39 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54
Jul 07 03:55:39 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:39 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff59b231-cff9-4a80-b338-09df551fd10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2cfe22-7e6e-49f6-872b-accf96f26419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:39 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Volume volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 (4e53f3cf-e8fc-44f0-a0ed-974a82c7d720): created successfully
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2cfe22-7e6e-49f6-872b-accf96f26419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Flow 'volume_create_manager' (7b9884fe-0166-4510-9d2d-9bad169892df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-96ccd585-db1d-4d9f-ba32-2e3f35795f2c tempest-ProjectReaderTests-1578117559 None] Created volume successfully.
Jul 07 03:55:40 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:40 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada
Jul 07 03:55:40 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "cinder-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Acquiring lock "cinder-quobyte-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281b353-f107-433a-a117-9460482e6989]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:41 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720
Jul 07 03:55:41 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:41 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:41 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada
Jul 07 03:55:41 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:41 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:41 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720
Jul 07 03:55:41 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:41 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54.efe5507e-fa5f-46b0-83eb-6d02a5b15ada" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-efe5507e-fa5f-46b0-83eb-6d02a5b15ada" released by "_delete_snapshot" :: held 3.132s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" released by "delete_snapshot" :: held 3.162s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Created reservations ['bd4ea806-4da0-458e-9195-9b6068839d51', '5ded4075-b9d1-4726-8099-63ee3dd4c9f1', 'cf6655a9-8ce8-48a4-93a5-ecdb9ef5f13e', 'ede0846a-5ed2-4913-81e3-a8e90fabdc2a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:55:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20d85f13-efd4-4246-928b-a71386795f19 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-efe5507e-fa5f-46b0-83eb-6d02a5b15ada-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:42 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "cinder-quobyte-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720" released by "delete_volume" :: held 1.485s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Created reservations ['3253228b-5160-4e9b-a11a-2c883ed6914b', 'cad94505-f7fa-46fe-849d-1561991bff7c', '1398c06c-33ba-449b-b1eb-7b91e267d54f', '6a462962-35a8-4248-ada4-61667ee0bd6b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:42 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:42 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-bfd94ad9-9626-4eba-abb1-c401ff332f54-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-bfd94ad9-9626-4eba-abb1-c401ff332f54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0c01d5-d711-4db7-a5a7-71e7095ad4a9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:43 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54
Jul 07 03:55:43 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:43 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:43 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:43 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Deleted volume successfully.
Jul 07 03:55:43 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fd0924d0-c520-4020-8954-c42635be528f tempest-ProjectReaderTests-1578117559 None] Lock "cinder-4e53f3cf-e8fc-44f0-a0ed-974a82c7d720-delete_volume" released by "delete_volume" :: held 2.337s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:43 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:43 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54
Jul 07 03:55:43 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:44 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-bfd94ad9-9626-4eba-abb1-c401ff332f54" returned: 0 in 0.709s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-bfd94ad9-9626-4eba-abb1-c401ff332f54" released by "delete_volume" :: held 1.574s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Created reservations ['4c4d1d5a-3497-4636-9cd9-9ca18e97c701', '5d7672b7-711b-41f4-b268-e7e8862f7659', '4f56211a-082e-4bc6-af6c-50979ab4bfb0', 'ba6bf7e2-4c57-45b6-8477-9316d0efbed4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:44 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:44 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:45 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.671s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-22d29616-1e8e-4385-97d2-073f6efc17e8 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-bfd94ad9-9626-4eba-abb1-c401ff332f54-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (64e609fa-3dfe-41b8-ae67-74e0bdb8939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6508919f-f5d8-4b3c-b2cc-901e679722aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6508919f-f5d8-4b3c-b2cc-901e679722aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141109757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03591ebb-c087-4861-9acf-9120b6ac1f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:46Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4186f1ea-e812-46d6-b673-39d686f31cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4186f1ea-e812-46d6-b673-39d686f31cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d979628-a406-4ece-a51b-156b60815561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d979628-a406-4ece-a51b-156b60815561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03591ebb-c087-4861-9acf-9120b6ac1f7a', 'volume_name': 'volume-03591ebb-c087-4861-9acf-9120b6ac1f7a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f955358b-21dc-44b8-85a2-a304882bb419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f955358b-21dc-44b8-85a2-a304882bb419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef0cec5-497b-4ae4-9801-d02cc602bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Volume 03591ebb-c087-4861-9acf-9120b6ac1f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03591ebb-c087-4861-9acf-9120b6ac1f7a', 'volume_size': 1}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141109757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03591ebb-c087-4861-9acf-9120b6ac1f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:55:46Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Creating volume 03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:55:45 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:55:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:45 devstack sudo[105922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a 1073741824
Jul 07 03:55:45 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:46 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a 1073741824" returned: 0 in 0.961s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:46 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a
Jul 07 03:55:46 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:47 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a" returned: 0 in 0.659s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef0cec5-497b-4ae4-9801-d02cc602bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03591ebb-c087-4861-9acf-9120b6ac1f7a', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06776cc7-28e9-4d1e-8e12-7fdf84796d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:55:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Volume volume-03591ebb-c087-4861-9acf-9120b6ac1f7a (03591ebb-c087-4861-9acf-9120b6ac1f7a): created successfully
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06776cc7-28e9-4d1e-8e12-7fdf84796d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (64e609fa-3dfe-41b8-ae67-74e0bdb8939b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:55:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c6f0e0e6-41b1-4001-bf78-5d55c529dbd6 tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 of volume 03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2abc729-336d-4747-a512-87d20bc8814b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:47 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a
Jul 07 03:55:47 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:48 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:48 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 1G
Jul 07 03:55:48 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:49 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 1G" returned: 0 in 0.840s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03591ebb-c087-4861-9acf-9120b6ac1f7a -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:49 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03591ebb-c087-4861-9acf-9120b6ac1f7a -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954
Jul 07 03:55:49 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:50 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03591ebb-c087-4861-9acf-9120b6ac1f7a -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" returned: 0 in 0.789s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:50 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 is being set with open permissions: ugo+rw
Jul 07 03:55:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:50 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954
Jul 07 03:55:50 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:51 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" returned: 0 in 0.734s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:51 devstack sudo[105987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info
Jul 07 03:55:51 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:51 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info" returned: 0 in 0.701s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:51 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info is being set with open permissions: ugo+rw
Jul 07 03:55:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:51 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info
Jul 07 03:55:51 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:52 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.info" returned: 0 in 0.679s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.646s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:52 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bb79a597-7983-421f-92e4-a49c1b875ad7 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 of volume 03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f046550-da29-41dc-bcdb-205697c85a59]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:53 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954
Jul 07 03:55:53 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:53 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" returned: 0 in 0.820s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03591ebb-c087-4861-9acf-9120b6ac1f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:55:54 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d8711-9e4a-4d5a-b390-73673fd8b13a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:54 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a
Jul 07 03:55:54 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:54 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a" returned: 0 in 0.777s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:54 devstack sudo[106009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954
Jul 07 03:55:54 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:55 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" returned: 0 in 0.765s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:55 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954
Jul 07 03:55:55 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:56 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a.47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954" released by "_delete_snapshot" :: held 3.150s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" released by "delete_snapshot" :: held 3.176s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:56 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Created reservations ['054b8a83-9902-4be4-b45e-ba5e3cfecddc', 'e7f45253-2dcf-4c80-ad6d-ae139aaacf32', '4d2237a2-4044-4fcf-89ca-da22b585feaf', 'e97cf321-5ead-4e99-8865-e5fcc958b466'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:56 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:55:56 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-6f611a16-7f6a-4841-b889-e826490181ce tempest-ProjectMemberTests-1617340040 None] Lock "cinder-47d0a2e9-37e9-4ff1-98e5-ce1ff09ef954-delete_snapshot" released by "delete_snapshot" :: held 3.324s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-03591ebb-c087-4861-9acf-9120b6ac1f7a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-03591ebb-c087-4861-9acf-9120b6ac1f7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[848f8cd0-b253-46db-8b0c-35cbdc0e658d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:55:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:57 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a
Jul 07 03:55:57 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:58 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a" returned: 0 in 0.784s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:58 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a
Jul 07 03:55:58 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:58 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-03591ebb-c087-4861-9acf-9120b6ac1f7a" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-03591ebb-c087-4861-9acf-9120b6ac1f7a" released by "delete_volume" :: held 1.502s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Created reservations ['d7646a2a-012c-4a8c-93e8-82fbfc965727', '55d7080e-3f8d-4968-8c2d-f36057f6795e', '50bb9aa0-f3ab-4e33-89a0-8627c7fc1d71', 'b8bb780e-78b2-40dc-abea-f347ad2b0b9b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:55:59 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:55:59 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:55:59 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.716s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:55:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:55:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e0673d34-b6e7-4436-a1b5-5128b8c822b5 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-03591ebb-c087-4861-9acf-9120b6ac1f7a-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (9f1bbdae-366c-4436-86ba-eef52948081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfdafac-7c9d-427e-97ea-95a6fcb79fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfdafac-7c9d-427e-97ea-95a6fcb79fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571155427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d720eaac-47d9-41bc-864b-89d560253bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:00Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0191b6b2-12ab-47f9-8486-ff6e9bc54c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0191b6b2-12ab-47f9-8486-ff6e9bc54c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403773fd-6655-4c26-8f22-d0f230a02e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403773fd-6655-4c26-8f22-d0f230a02e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd720eaac-47d9-41bc-864b-89d560253bdf', 'volume_name': 'volume-d720eaac-47d9-41bc-864b-89d560253bdf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb78c8f-5b82-4c74-8ffd-42f7a01a1710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cb78c8f-5b82-4c74-8ffd-42f7a01a1710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9384e9-5915-49b0-bb10-9df190c8899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Volume d720eaac-47d9-41bc-864b-89d560253bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d720eaac-47d9-41bc-864b-89d560253bdf', 'volume_size': 1}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571155427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d720eaac-47d9-41bc-864b-89d560253bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:00Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Creating volume d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:56:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:00 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf 1073741824
Jul 07 03:56:00 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:01 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf 1073741824" returned: 0 in 0.891s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:01 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf
Jul 07 03:56:01 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:01 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf" returned: 0 in 0.681s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9384e9-5915-49b0-bb10-9df190c8899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d720eaac-47d9-41bc-864b-89d560253bdf', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047c65d1-4aba-412f-98d7-bb4d137c0297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=155,cinder:SELECT=130,cinder:DELETE=13,cinder:INSERT=46 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:56:01 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Volume volume-d720eaac-47d9-41bc-864b-89d560253bdf (d720eaac-47d9-41bc-864b-89d560253bdf): created successfully
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047c65d1-4aba-412f-98d7-bb4d137c0297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:01 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (9f1bbdae-366c-4436-86ba-eef52948081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:01 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-14ec67b6-d2c6-48e8-bd9d-789ea7c3710d tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=109,cinder:UPDATE=172,cinder:INSERT=41,cinder:DELETE=14 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot a41bee19-9dc4-4497-b599-6ec5d4a4e596 of volume d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c58b85-f179-4b54-8a67-698cc5162abb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:02 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf
Jul 07 03:56:02 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:03 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:03 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 1G
Jul 07 03:56:03 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:04 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 1G" returned: 0 in 0.882s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d720eaac-47d9-41bc-864b-89d560253bdf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:04 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d720eaac-47d9-41bc-864b-89d560253bdf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596
Jul 07 03:56:04 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:04 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d720eaac-47d9-41bc-864b-89d560253bdf -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:04 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 is being set with open permissions: ugo+rw
Jul 07 03:56:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:04 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596
Jul 07 03:56:04 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:05 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:05 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info
Jul 07 03:56:05 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Flow 'volume_create_manager' (8557e40f-7166-4daa-8d3d-1f48ee79a001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cdd1b0-e2ab-42c8-93e2-bc253868efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cdd1b0-e2ab-42c8-93e2-bc253868efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-798926374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9e637-8bcf-4d92-831c-96115ef8ed8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb276a5c580643e4a8f5eb33c0a536e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:06Z,use_quota=True,user_id='ee88eb8e394f4ffcac7de67ff6f407f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71de432-e2fc-4150-9b35-a835dec1281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71de432-e2fc-4150-9b35-a835dec1281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b285404-32a9-4f2b-b3d6-1d9493386b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b285404-32a9-4f2b-b3d6-1d9493386b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e9e637-8bcf-4d92-831c-96115ef8ed8d', 'volume_name': 'volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087c5514-e2d9-45c5-89ba-1c2b059ffc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087c5514-e2d9-45c5-89ba-1c2b059ffc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e72970c-f72b-4fd4-8e1f-66887fced962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:05 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Volume 79e9e637-8bcf-4d92-831c-96115ef8ed8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d', 'volume_size': 1}
Jul 07 03:56:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:06 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info" returned: 0 in 0.637s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info is being set with open permissions: ugo+rw
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:06 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info
Jul 07 03:56:06 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:06 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.info" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-798926374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9e637-8bcf-4d92-831c-96115ef8ed8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb276a5c580643e4a8f5eb33c0a536e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:06Z,use_quota=True,user_id='ee88eb8e394f4ffcac7de67ff6f407f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Creating volume 79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:06 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:56:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:06 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d 1073741824
Jul 07 03:56:06 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:06 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2f4efd6a-9c43-4825-9230-9efd9c27f7c3 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-a41bee19-9dc4-4497-b599-6ec5d4a4e596-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-a41bee19-9dc4-4497-b599-6ec5d4a4e596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:07 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-a41bee19-9dc4-4497-b599-6ec5d4a4e596" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d 1073741824" returned: 0 in 0.822s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-a41bee19-9dc4-4497-b599-6ec5d4a4e596" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot a41bee19-9dc4-4497-b599-6ec5d4a4e596 of volume d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18718ea-3cfc-4285-8056-fcc4b4fe764d]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:07 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:07 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:07 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596
Jul 07 03:56:07 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:08 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.666s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e72970c-f72b-4fd4-8e1f-66887fced962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8ce67-41a9-4fb6-a74c-13f70e8c8787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:08 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Volume volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d (79e9e637-8bcf-4d92-831c-96115ef8ed8d): created successfully
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c8ce67-41a9-4fb6-a74c-13f70e8c8787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Flow 'volume_create_manager' (8557e40f-7166-4daa-8d3d-1f48ee79a001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:08 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7e0c8041-bb6e-4b42-a71c-ebd671eb7c6a tempest-SnapshotDependencyTests-1139863979 None] Created volume successfully.
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596" returned: 0 in 0.759s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d720eaac-47d9-41bc-864b-89d560253bdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[24540d24-c86c-41eb-bbdd-992dd424a65c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:08 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf
Jul 07 03:56:08 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Creating offline snapshot 1e5cba2c-fcf3-45af-a184-e82f8e2e2649 of volume 79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e77651a-b2a1-4027-98ca-af202839512c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:09 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:09 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:09 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf" returned: 0 in 0.769s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:09 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596
Jul 07 03:56:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:09 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:09 devstack sudo[106096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 1G
Jul 07 03:56:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:10 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596" returned: 0 in 0.776s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:10 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596
Jul 07 03:56:10 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:10 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 1G" returned: 0 in 0.807s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:10 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:10 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:10 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf.a41bee19-9dc4-4497-b599-6ec5d4a4e596" returned: 0 in 0.668s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-a41bee19-9dc4-4497-b599-6ec5d4a4e596" released by "_delete_snapshot" :: held 3.070s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" released by "delete_snapshot" :: held 3.098s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Created reservations ['fcbc0f55-28b2-4015-9276-967c4e3129ca', '65d6ce66-fea7-4b3b-95b9-3d2928cf0dba', '9c72516b-dc3a-49f8-bddf-38abaa6385fd', '18e42eb1-d381-4416-a4bc-8435cf1429d5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:10 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:56:10 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1d79ad39-43d2-47b0-82b8-bf4ebab955fa tempest-ProjectMemberTests-1617340040 None] Lock "cinder-a41bee19-9dc4-4497-b599-6ec5d4a4e596-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:11 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:11 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 is being set with open permissions: ugo+rw
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:11 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:11 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-d720eaac-47d9-41bc-864b-89d560253bdf-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "cinder-d720eaac-47d9-41bc-864b-89d560253bdf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:11 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[692bfd9f-19ae-409c-9def-8ec352b01ecf]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:12 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info
Jul 07 03:56:12 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:12 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf
Jul 07 03:56:12 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:12 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info" returned: 0 in 0.658s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:12 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info is being set with open permissions: ugo+rw
Jul 07 03:56:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:12 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info
Jul 07 03:56:12 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:12 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:12 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf
Jul 07 03:56:12 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:13 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.info" returned: 0 in 0.657s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.403s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ec49dd88-a05c-4d1a-ad14-46c7dfda179b tempest-SnapshotDependencyTests-1139863979 None] Create snapshot completed successfully
Jul 07 03:56:13 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-d720eaac-47d9-41bc-864b-89d560253bdf" returned: 0 in 0.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-d720eaac-47d9-41bc-864b-89d560253bdf" released by "delete_volume" :: held 1.517s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Created reservations ['600d6976-4c10-4d85-a29b-29481bc5ddf0', '553b5a02-b4b9-49c3-a3b1-9872fc88a579', 'bb0362bd-16d8-4f89-88d3-509e2da6d4f3', '58b167ac-85a1-4868-bd62-4e463217540e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:13 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:13 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:14 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.658s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a073a959-bec8-4000-be2f-600cf6564dfc tempest-ProjectMemberTests-1617340040 None] Lock "cinder-d720eaac-47d9-41bc-864b-89d560253bdf-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (4fb7065c-48f6-4408-b7b3-c35116e63024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139af51e-94a6-45f7-9806-164f189787c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139af51e-94a6-45f7-9806-164f189787c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135571589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:14Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d45e2c-0a33-4aa6-93fe-b50e6fa505d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d45e2c-0a33-4aa6-93fe-b50e6fa505d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff78d017-e9d0-485d-91d5-50f841109697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff78d017-e9d0-485d-91d5-50f841109697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4', 'volume_name': 'volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bb82be-563e-45da-8d1b-a826a998ba8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bb82be-563e-45da-8d1b-a826a998ba8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8279d419-0c6b-47a1-9307-9d9158b9293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Volume 9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4', 'volume_size': 1}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1135571589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:14Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Creating volume 9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:14 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 1073741824
Jul 07 03:56:14 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Flow 'volume_create_manager' (a686126b-7265-41ee-859b-d8c2ae8a8f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6a223-818c-4e96-ba73-bb819967a9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7f6a223-818c-4e96-ba73-bb819967a9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=272154b6-eab3-49d6-8944-20b2d5a9561a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb276a5c580643e4a8f5eb33c0a536e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e5cba2c-fcf3-45af-a184-e82f8e2e2649,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:15Z,use_quota=True,user_id='ee88eb8e394f4ffcac7de67ff6f407f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e067c49-5275-4ddd-9766-38a7de89cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e067c49-5275-4ddd-9766-38a7de89cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0bfe8-8c92-4d03-a929-b0f58628ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7a0bfe8-8c92-4d03-a929-b0f58628ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '272154b6-eab3-49d6-8944-20b2d5a9561a', 'volume_name': 'volume-272154b6-eab3-49d6-8944-20b2d5a9561a', 'volume_size': 1, 'snapshot_id': '1e5cba2c-fcf3-45af-a184-e82f8e2e2649'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5a6181-6666-414a-bd0c-3db4d52a1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5a6181-6666-414a-bd0c-3db4d52a1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce928394-1aa8-45b0-95a2-862f9b678ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Volume 272154b6-eab3-49d6-8944-20b2d5a9561a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-272154b6-eab3-49d6-8944-20b2d5a9561a', 'volume_size': 1, 'snapshot_id': '1e5cba2c-fcf3-45af-a184-e82f8e2e2649'}
Jul 07 03:56:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:15 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:15 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:15 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 1073741824" returned: 0 in 0.838s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:15 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4
Jul 07 03:56:15 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:16 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:56:16 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" returned: 0 in 0.660s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.359s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-272154b6-eab3-49d6-8944-20b2d5a9561a" by "_create_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8279d419-0c6b-47a1-9307-9d9158b9293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb976c2-9480-4a49-a850-30a205f9652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-272154b6-eab3-49d6-8944-20b2d5a9561a" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Creating volume 272154b6-eab3-49d6-8944-20b2d5a9561a from snapshot 1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" by "_copy_volume_from_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:16 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Volume volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 (9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4): created successfully
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb976c2-9480-4a49-a850-30a205f9652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (4fb7065c-48f6-4408-b7b3-c35116e63024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] snapshot: 1e5cba2c-fcf3-45af-a184-e82f8e2e2649, volume: 272154b6-eab3-49d6-8944-20b2d5a9561a,  {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 03:56:16 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-32269d9d-58ba-4522-8875-b21bc61e42be tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe07431e-9332-4c6f-902c-1672440a7dc7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:16 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:16 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:17 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Creating direct copy from snapshot {{(pid=86955) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e258f-311f-4ab0-b18f-761d8bc96e5e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:17 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:17 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:17 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.774s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG cinder.utils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Path /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a not found in is_blk_device check {{(pid=86955) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 03:56:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:17 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a
Jul 07 03:56:17 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:22 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a" returned: 0 in 4.466s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160655b-e4f7-41e4-a6b1-af052790d46a]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:22 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:22 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:23 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.935s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.image.image_utils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Image conversion details: src /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a {{(pid=86955) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 03:56:23 devstack cinder-volume[86955]: INFO cinder.image.image_utils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Converted 1024.00 MB image at 229.22 MB/s
Jul 07 03:56:23 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a is being set with open permissions: ugo+rw
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:23 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a
Jul 07 03:56:23 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:23 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a" returned: 0 in 0.624s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" released by "_copy_volume_from_snapshot" :: held 7.639s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-272154b6-eab3-49d6-8944-20b2d5a9561a" released by "_create_volume_from_snapshot" :: held 7.679s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.713s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.122s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 866c2bef-d428-495e-b5f2-9a08d1b00f1e of volume 9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce928394-1aa8-45b0-95a2-862f9b678ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-272154b6-eab3-49d6-8944-20b2d5a9561a', 'volume_size': 1, 'snapshot_id': '1e5cba2c-fcf3-45af-a184-e82f8e2e2649'}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a82b0c8-1328-4df1-8cf5-f44b7db9d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c1532-dbab-4bc8-9aac-afb0ee48c0c3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:23 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Volume volume-272154b6-eab3-49d6-8944-20b2d5a9561a (272154b6-eab3-49d6-8944-20b2d5a9561a): created successfully
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a82b0c8-1328-4df1-8cf5-f44b7db9d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:23 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Flow 'volume_create_manager' (a686126b-7265-41ee-859b-d8c2ae8a8f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:23 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5cf611bb-4036-460d-8bcf-f68212f67ba5 tempest-SnapshotDependencyTests-1139863979 None] Created volume successfully.
Jul 07 03:56:24 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4
Jul 07 03:56:24 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Deleting offline snapshot 1e5cba2c-fcf3-45af-a184-e82f8e2e2649 of volume 79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] snapshot_file for this snap is: volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e851b11b-2713-4802-9804-7d40d646ce7c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:24 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:24 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:24 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:24 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e 1G
Jul 07 03:56:24 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:25 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.763s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2883b233-75d8-4abf-9d5d-575e15faacb0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:25 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:25 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:25 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e 1G" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:25 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e
Jul 07 03:56:25 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:26 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:26 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:26 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:26 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e" returned: 0 in 0.693s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:26 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e is being set with open permissions: ugo+rw
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:26 devstack sudo[106205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e
Jul 07 03:56:26 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:26 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:26 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.722s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e" returned: 0 in 0.661s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:26 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649
Jul 07 03:56:26 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:26 devstack sudo[106213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info
Jul 07 03:56:26 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:27 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d.1e5cba2c-fcf3-45af-a184-e82f8e2e2649" returned: 0 in 0.632s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-1e5cba2c-fcf3-45af-a184-e82f8e2e2649" released by "_delete_snapshot" :: held 3.005s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" released by "delete_snapshot" :: held 3.027s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:27 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info" returned: 0 in 0.675s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:27 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info is being set with open permissions: ugo+rw
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:27 devstack sudo[106217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info
Jul 07 03:56:27 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Created reservations ['23f341d3-4b20-4313-add5-c27c30fed69a', 'bea72061-b9bc-4c70-bc50-27e94f0b146a', 'e4388b1f-703a-4af1-8731-a3cd15395f4c', '29c740ec-ad32-486d-8457-cf52358ad763'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Delete snapshot completed successfully.
Jul 07 03:56:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58fb36ab-95c9-4fe6-8e57-a985dee6b29c tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-1e5cba2c-fcf3-45af-a184-e82f8e2e2649-delete_snapshot" released by "delete_snapshot" :: held 3.180s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:28 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.info" returned: 0 in 0.618s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.313s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:28 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-10c2e605-afd7-4d28-a999-5e753e22f632 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-866c2bef-d428-495e-b5f2-9a08d1b00f1e-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-866c2bef-d428-495e-b5f2-9a08d1b00f1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-866c2bef-d428-495e-b5f2-9a08d1b00f1e" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-866c2bef-d428-495e-b5f2-9a08d1b00f1e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 866c2bef-d428-495e-b5f2-9a08d1b00f1e of volume 9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f486b-e3db-4e3a-8ba7-00edbd3bac5f]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:28 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e
Jul 07 03:56:28 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-79e9e637-8bcf-4d92-831c-96115ef8ed8d-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-79e9e637-8bcf-4d92-831c-96115ef8ed8d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cd4543-e8b4-4b1e-83d2-4ff41fb41dc5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:28 devstack sudo[106222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:28 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:29 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e" returned: 0 in 0.750s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b5d70-8ce2-4496-a13b-bd66d25eaeb5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:29 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4
Jul 07 03:56:29 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:29 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.758s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:29 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d
Jul 07 03:56:29 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:29 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" returned: 0 in 0.743s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:29 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e
Jul 07 03:56:29 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:30 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-79e9e637-8bcf-4d92-831c-96115ef8ed8d" returned: 0 in 0.662s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-79e9e637-8bcf-4d92-831c-96115ef8ed8d" released by "delete_volume" :: held 1.477s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Created reservations ['c1a1556e-32ef-44b8-a85b-f24e188cb1ac', '88ad589a-4318-4458-8093-d257c9e7b55a', '6ff23099-247e-4338-87be-b06ea6f12be2', 'd482360c-cc1d-4efe-acee-80e5a989a1b1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:30 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:30 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:30 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e" returned: 0 in 0.722s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:30 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e
Jul 07 03:56:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-272154b6-eab3-49d6-8944-20b2d5a9561a-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:30 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-272154b6-eab3-49d6-8944-20b2d5a9561a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" acquired by "delete_volume" :: waited 0.025s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:31 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d980c30-6ad3-4027-b02c-e5cb2aa1ce42]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.719s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Deleted volume successfully.
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d6f75318-95ed-4ca8-bc01-47de23a7de16 tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-79e9e637-8bcf-4d92-831c-96115ef8ed8d-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:31 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a
Jul 07 03:56:31 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:31 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4.866c2bef-d428-495e-b5f2-9a08d1b00f1e" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-866c2bef-d428-495e-b5f2-9a08d1b00f1e" released by "_delete_snapshot" :: held 2.949s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" released by "delete_snapshot" :: held 2.975s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Created reservations ['add7761c-033c-4165-b345-f5bf7862f793', 'e55a2da8-360a-4700-a46a-c368e2ede7a4', 'c560ba0a-8596-4cb9-bf26-7dcd946d0373', '1d70afb5-2116-4cd6-a111-1277c8b5d7e3'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:31 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-b8f20978-92a0-419e-b663-c26577d18ead tempest-ProjectMemberTests-1617340040 None] Lock "cinder-866c2bef-d428-495e-b5f2-9a08d1b00f1e-delete_snapshot" released by "delete_snapshot" :: held 3.120s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c9f6b-8bee-43b7-af8b-c7291b715255]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:31 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4
Jul 07 03:56:31 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:31 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:31 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a
Jul 07 03:56:31 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:32 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" returned: 0 in 0.789s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:32 devstack sudo[106264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4
Jul 07 03:56:32 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:32 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-272154b6-eab3-49d6-8944-20b2d5a9561a" returned: 0 in 0.670s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-quobyte-272154b6-eab3-49d6-8944-20b2d5a9561a" released by "delete_volume" :: held 1.513s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Created reservations ['a28d45db-a46e-4689-a24a-7fe834f7f9c9', '6ece0d38-4cee-4aeb-837c-a1cb5f469387', '426ca8f5-9036-45ed-81d5-e7f7066ee810', 'bab8942e-6779-4c85-ac46-7a4334eb571d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:32 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:32 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:33 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4" released by "delete_volume" :: held 1.518s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Created reservations ['edba0909-0c47-4776-a17d-d2104a7946c6', 'f8a20e28-e3e9-4333-b031-b5b55c446f0a', '0cf40876-2c0b-44d4-b5be-63b9ff8fc3bf', '33504f72-163a-4f9a-8d0d-5611bdbe62c9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:33 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:33 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:33 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.678s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Deleted volume successfully.
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-528ef32d-0484-4473-b17e-c6f3a45cd6fa tempest-SnapshotDependencyTests-1139863979 None] Lock "cinder-272154b6-eab3-49d6-8944-20b2d5a9561a-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:33 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.674s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:33 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bf49dca9-96b0-413a-ab98-fe9003410cd1 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-9e7b49bf-5b30-4daf-9ec6-ea76e4aa7ea4-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (bfabc861-75ce-4560-ba40-aa139a008ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a29f3e2-f513-4c50-9c0a-76cce6d4eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a29f3e2-f513-4c50-9c0a-76cce6d4eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403408538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b860d4a-ad8b-404e-8433-2beeb389c325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:34Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd3af82-192c-4e88-a6cd-300d01223818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd3af82-192c-4e88-a6cd-300d01223818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20018651-5531-456f-b9ac-794250fcd8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20018651-5531-456f-b9ac-794250fcd8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b860d4a-ad8b-404e-8433-2beeb389c325', 'volume_name': 'volume-2b860d4a-ad8b-404e-8433-2beeb389c325', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01115aa8-189d-4782-aebe-265c3e865bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01115aa8-189d-4782-aebe-265c3e865bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd761f5d-8e77-4067-9a62-173de0c84717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:34 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Volume 2b860d4a-ad8b-404e-8433-2beeb389c325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b860d4a-ad8b-404e-8433-2beeb389c325', 'volume_size': 1}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403408538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b860d4a-ad8b-404e-8433-2beeb389c325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:34Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Creating volume 2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:34 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:56:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:34 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 1073741824
Jul 07 03:56:34 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:35 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 1073741824" returned: 0 in 0.846s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:35 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325
Jul 07 03:56:35 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:35 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325" returned: 0 in 0.680s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:35 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd761f5d-8e77-4067-9a62-173de0c84717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b860d4a-ad8b-404e-8433-2beeb389c325', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a0a9e-cdbe-45e4-8ac8-3dc366affb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:36 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Volume volume-2b860d4a-ad8b-404e-8433-2beeb389c325 (2b860d4a-ad8b-404e-8433-2beeb389c325): created successfully
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710a0a9e-cdbe-45e4-8ac8-3dc366affb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (bfabc861-75ce-4560-ba40-aa139a008ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b8095516-8098-40e3-a8ab-c6a3297e2627 tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f of volume 2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92cd33f-4e78-4c9c-9a0c-6eb5c34b9411]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:36 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325
Jul 07 03:56:36 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:37 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325" returned: 0 in 0.801s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:37 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f 1G
Jul 07 03:56:37 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:38 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f 1G" returned: 0 in 0.879s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b860d4a-ad8b-404e-8433-2beeb389c325 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:38 devstack sudo[106295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b860d4a-ad8b-404e-8433-2beeb389c325 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f
Jul 07 03:56:38 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:38 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b860d4a-ad8b-404e-8433-2beeb389c325 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" returned: 0 in 0.712s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:38 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f is being set with open permissions: ugo+rw
Jul 07 03:56:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:39 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f
Jul 07 03:56:39 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:39 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" returned: 0 in 0.693s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:39 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info
Jul 07 03:56:39 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:40 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info" returned: 0 in 0.713s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:40 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info is being set with open permissions: ugo+rw
Jul 07 03:56:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:40 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info
Jul 07 03:56:40 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:41 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.info" returned: 0 in 0.678s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.562s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-daa67009-d9bc-411f-b81f-cf44de1446cc tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f of volume 2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed261efd-5ea8-47f3-bdd5-d39586752d57]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:42 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f
Jul 07 03:56:42 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:42 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" returned: 0 in 0.751s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b860d4a-ad8b-404e-8433-2beeb389c325(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c895701-4d8d-4487-81ed-6a3fd0bf90c5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:42 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325
Jul 07 03:56:42 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:43 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325" returned: 0 in 0.772s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:43 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f
Jul 07 03:56:43 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:44 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" returned: 0 in 0.718s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:44 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f
Jul 07 03:56:44 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:44 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325.cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" returned: 0 in 0.637s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f" released by "_delete_snapshot" :: held 2.972s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" released by "delete_snapshot" :: held 2.992s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Created reservations ['c72d5a56-0a21-43c4-82a6-e23261a1aa28', '96d2d943-3b0b-4f0c-8ffa-3b781be75686', 'e5cf98cd-23e5-4b3b-9d34-3cb3227a1d1a', 'd6f05d6f-dcfe-40a5-95cf-953f6dbb2e43'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:44 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-da10a620-2532-4eb8-a825-0540dc9eb32f tempest-ProjectMemberTests-1617340040 None] Lock "cinder-cbf3d6df-2ec0-4d6e-bac1-96832a6d2c6f-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-2b860d4a-ad8b-404e-8433-2beeb389c325-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:44 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-2b860d4a-ad8b-404e-8433-2beeb389c325-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[320c513a-5d11-46e5-918c-f2266261679b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:45 devstack sudo[106332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325
Jul 07 03:56:45 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:45 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325" returned: 0 in 0.738s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:45 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325
Jul 07 03:56:45 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:46 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-2b860d4a-ad8b-404e-8433-2beeb389c325" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-2b860d4a-ad8b-404e-8433-2beeb389c325" released by "delete_volume" :: held 1.434s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Created reservations ['b3339692-b2ed-496c-ae58-cbf02329e57b', '0c5a2457-f98a-4367-9848-c5a9b58ae18f', '1b00c123-0511-4bcc-8551-764ecd184820', '4e038d86-b9ce-4ccd-9a5e-42b32e8464eb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:46 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:46 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:47 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:56:47 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-91783f31-a2ff-4c17-a413-84fc2b176039 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-2b860d4a-ad8b-404e-8433-2beeb389c325-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (8780ce0e-77c1-451f-99d4-7a65697d1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd04b1b6-df4c-4ce5-8bc0-d98bafa22fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd04b1b6-df4c-4ce5-8bc0-d98bafa22fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708443410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd06f9-e38c-42a5-baf0-d709593c01c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:48Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64923ed-ff8a-424a-89c8-ffa542180690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64923ed-ff8a-424a-89c8-ffa542180690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9adbc-f1b0-43cc-aede-7903ab00a6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b9adbc-f1b0-43cc-aede-7903ab00a6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67dd06f9-e38c-42a5-baf0-d709593c01c4', 'volume_name': 'volume-67dd06f9-e38c-42a5-baf0-d709593c01c4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c31aa7-aa12-4272-b4d8-bef5fdfe7dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4c31aa7-aa12-4272-b4d8-bef5fdfe7dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62dd7a-e554-48a0-a104-cdd9fd41e95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:47 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Volume 67dd06f9-e38c-42a5-baf0-d709593c01c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67dd06f9-e38c-42a5-baf0-d709593c01c4', 'volume_size': 1}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:56:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1708443410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67dd06f9-e38c-42a5-baf0-d709593c01c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:56:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:56:48Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Creating volume 67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:56:47 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:56:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:47 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 1073741824
Jul 07 03:56:47 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:48 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 1073741824" returned: 0 in 0.820s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:48 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4
Jul 07 03:56:48 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:49 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4" returned: 0 in 0.651s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f62dd7a-e554-48a0-a104-cdd9fd41e95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67dd06f9-e38c-42a5-baf0-d709593c01c4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acb2187-c7f4-4ab2-a6db-bd857620d6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:56:49 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Volume volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 (67dd06f9-e38c-42a5-baf0-d709593c01c4): created successfully
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9acb2187-c7f4-4ab2-a6db-bd857620d6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (8780ce0e-77c1-451f-99d4-7a65697d1e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:56:49 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1bc47cea-a730-4820-a082-262a3135ee5a tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 42f296fe-d378-4e2e-b943-dfb2f35be66a of volume 67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600fa17-44fa-45d1-be29-7c2c3e54dbba]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:50 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4
Jul 07 03:56:50 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:50 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4" returned: 0 in 0.771s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:50 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a 1G
Jul 07 03:56:50 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:51 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a 1G" returned: 0 in 0.805s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:51 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a
Jul 07 03:56:51 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:52 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a" returned: 0 in 0.693s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:52 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a is being set with open permissions: ugo+rw
Jul 07 03:56:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:52 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a
Jul 07 03:56:52 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:52 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a" returned: 0 in 0.638s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:52 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info
Jul 07 03:56:52 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:53 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info" returned: 0 in 0.657s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:53 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info is being set with open permissions: ugo+rw
Jul 07 03:56:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:53 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info
Jul 07 03:56:53 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:54 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.info" returned: 0 in 0.653s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.293s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6b5e5319-ee64-441d-965c-da6d3b08ba62 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-42f296fe-d378-4e2e-b943-dfb2f35be66a-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-42f296fe-d378-4e2e-b943-dfb2f35be66a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-42f296fe-d378-4e2e-b943-dfb2f35be66a" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-42f296fe-d378-4e2e-b943-dfb2f35be66a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 42f296fe-d378-4e2e-b943-dfb2f35be66a of volume 67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e46ecd5-36ce-4be3-bf8d-6aed22b253c8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:55 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a
Jul 07 03:56:55 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:55 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a" returned: 0 in 0.735s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67dd06f9-e38c-42a5-baf0-d709593c01c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef037d1-e481-41a1-a0a9-d478fb781d37]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:56 devstack sudo[106424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4
Jul 07 03:56:56 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:56 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:56 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a
Jul 07 03:56:56 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:57 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a" returned: 0 in 0.718s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:57 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a
Jul 07 03:56:57 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:58 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4.42f296fe-d378-4e2e-b943-dfb2f35be66a" returned: 0 in 0.646s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-42f296fe-d378-4e2e-b943-dfb2f35be66a" released by "_delete_snapshot" :: held 2.942s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" released by "delete_snapshot" :: held 2.967s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Created reservations ['60b1be85-abeb-4741-a7a9-ad9369172a26', 'bb2af189-16c3-4878-9cdf-c9e0b2015ef3', '19cc5d2f-bdc0-4ced-86b5-9496a3111bb8', '2329a0ad-c655-48ce-8daf-a0d7f57aacc4'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:58 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bbf0aa48-24db-498f-add7-3f1bad6a1968 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-42f296fe-d378-4e2e-b943-dfb2f35be66a-delete_snapshot" released by "delete_snapshot" :: held 3.089s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-67dd06f9-e38c-42a5-baf0-d709593c01c4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-67dd06f9-e38c-42a5-baf0-d709593c01c4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19e309-f60e-43be-b912-174abfe2e9d5]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:56:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:58 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4
Jul 07 03:56:58 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:59 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4" returned: 0 in 0.753s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:59 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4
Jul 07 03:56:59 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:56:59 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-67dd06f9-e38c-42a5-baf0-d709593c01c4" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-67dd06f9-e38c-42a5-baf0-d709593c01c4" released by "delete_volume" :: held 1.452s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Created reservations ['d09f54b9-fc22-4f25-ad94-c931c70f2f19', 'a7bfd792-cc1b-4b58-b4df-df81983a887f', '3b9cfea6-10f4-46dc-b233-0db91ae216f1', 'cbfa0f54-cc15-4de8-b44a-d5c2c5a5b19a'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:56:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:56:59 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:56:59 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:00 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.660s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:00 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-39046ff3-b565-4ed6-a224-0d4012beee84 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-67dd06f9-e38c-42a5-baf0-d709593c01c4-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (ab0d6611-1008-40c3-af33-5508269f0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dfec5f-ec74-49d3-b8cb-449203a65455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95dfec5f-ec74-49d3-b8cb-449203a65455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910416602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a3bf48-a05b-4969-905a-98529c1c85f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:01Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd954a9-08c5-440e-9710-7cf5f3addd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd954a9-08c5-440e-9710-7cf5f3addd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7ef420-d8eb-4827-990b-39747ad3f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff7ef420-d8eb-4827-990b-39747ad3f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a3bf48-a05b-4969-905a-98529c1c85f2', 'volume_name': 'volume-56a3bf48-a05b-4969-905a-98529c1c85f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8863424c-d4f3-4ffe-be8d-905552ccd1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8863424c-d4f3-4ffe-be8d-905552ccd1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c382d0b-5f8f-4bae-9e21-6e824d09d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:00 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Volume 56a3bf48-a05b-4969-905a-98529c1c85f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a3bf48-a05b-4969-905a-98529c1c85f2', 'volume_size': 1}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-910416602',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a3bf48-a05b-4969-905a-98529c1c85f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:01Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Creating volume 56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:57:00 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:57:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:00 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 1073741824
Jul 07 03:57:00 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:01 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 1073741824" returned: 0 in 0.800s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:01 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2
Jul 07 03:57:01 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:02 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2" returned: 0 in 0.617s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=83,cinder:UPDATE=99,cinder:DELETE=9,cinder:INSERT=28 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c382d0b-5f8f-4bae-9e21-6e824d09d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a3bf48-a05b-4969-905a-98529c1c85f2', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3dcbe9-1a3f-4ff1-a150-f0729d8fb9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=100,cinder:INSERT=26,cinder:SELECT=75,cinder:DELETE=7 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:57:02 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Volume volume-56a3bf48-a05b-4969-905a-98529c1c85f2 (56a3bf48-a05b-4969-905a-98529c1c85f2): created successfully
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3dcbe9-1a3f-4ff1-a150-f0729d8fb9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:02 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (ab0d6611-1008-40c3-af33-5508269f0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:02 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cb5a856d-ef7e-4419-be1a-88c0851cd3d1 tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 324a5b26-46d5-449f-b694-b337f961458b of volume 56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[d250269d-acae-43ae-a459-c515444cf2bc]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:03 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2
Jul 07 03:57:03 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:03 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2" returned: 0 in 0.751s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:03 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b 1G
Jul 07 03:57:03 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:04 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b 1G" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a3bf48-a05b-4969-905a-98529c1c85f2 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:04 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a3bf48-a05b-4969-905a-98529c1c85f2 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b
Jul 07 03:57:04 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:05 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56a3bf48-a05b-4969-905a-98529c1c85f2 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b" returned: 0 in 0.706s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:05 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b is being set with open permissions: ugo+rw
Jul 07 03:57:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:05 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b
Jul 07 03:57:05 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:06 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b" returned: 0 in 0.623s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:06 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info
Jul 07 03:57:06 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:06 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info" returned: 0 in 0.669s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:06 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info is being set with open permissions: ugo+rw
Jul 07 03:57:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:06 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info
Jul 07 03:57:06 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:07 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.info" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.273s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:07 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3673a882-5e14-4c1c-a8fe-a5c06876e766 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-324a5b26-46d5-449f-b694-b337f961458b-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-324a5b26-46d5-449f-b694-b337f961458b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-324a5b26-46d5-449f-b694-b337f961458b" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-324a5b26-46d5-449f-b694-b337f961458b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 324a5b26-46d5-449f-b694-b337f961458b of volume 56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab70326b-4838-45cb-87c0-57ba1a7bb498]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:08 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b
Jul 07 03:57:08 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:09 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56a3bf48-a05b-4969-905a-98529c1c85f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab836016-261b-497f-b5c0-3011d7a85546]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:09 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2
Jul 07 03:57:09 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:09 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2" returned: 0 in 0.721s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:09 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b
Jul 07 03:57:09 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:10 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b" returned: 0 in 0.708s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:10 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b
Jul 07 03:57:10 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:11 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2.324a5b26-46d5-449f-b694-b337f961458b" returned: 0 in 0.638s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-324a5b26-46d5-449f-b694-b337f961458b" released by "_delete_snapshot" :: held 2.894s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" released by "delete_snapshot" :: held 2.917s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Created reservations ['6920c506-f4ff-4bc7-8f25-8902cc6cf104', '5704709e-1339-40d6-8c07-74a7c06d9a6a', '47ee35d7-d481-468e-8a8a-ba69dc5bd009', '37e996e2-30ce-45fb-b08f-4a7d61118d1e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:11 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7558d7d2-875a-429e-8ec8-ddee662405e0 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-324a5b26-46d5-449f-b694-b337f961458b-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-56a3bf48-a05b-4969-905a-98529c1c85f2-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "cinder-56a3bf48-a05b-4969-905a-98529c1c85f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" acquired by "delete_volume" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b5e7aa-bae4-4eee-83d7-567ea58debe1]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:11 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2
Jul 07 03:57:11 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:12 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2" returned: 0 in 0.771s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:12 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2
Jul 07 03:57:12 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:13 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-56a3bf48-a05b-4969-905a-98529c1c85f2" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-56a3bf48-a05b-4969-905a-98529c1c85f2" released by "delete_volume" :: held 1.470s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Created reservations ['337881a5-b795-4098-a776-d59b3c44feb9', '678caa3d-0880-4f2b-8e0c-ec66405fff0f', 'c79629fa-b1c4-4964-a2d5-e1c4d3ff739f', 'e84cd6aa-974f-4983-94bd-dd9a04de1e66'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:13 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:57:13 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:13 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:13 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:57:13 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-3198f644-0428-4647-988e-960a8f6408bd tempest-ProjectMemberTests-1617340040 None] Lock "cinder-56a3bf48-a05b-4969-905a-98529c1c85f2-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (42256760-06c2-4de4-a142-ecc38ef4aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba7566b-84be-49b1-9607-c97f6e4a37fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba7566b-84be-49b1-9607-c97f6e4a37fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888272613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cab5642-6543-4915-9cd7-78c3a1e31f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:14Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8971b197-cdef-40cc-8d2e-306043047937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8971b197-cdef-40cc-8d2e-306043047937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428607ed-9f2c-44d5-a0f7-441d7e2c9f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428607ed-9f2c-44d5-a0f7-441d7e2c9f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cab5642-6543-4915-9cd7-78c3a1e31f30', 'volume_name': 'volume-9cab5642-6543-4915-9cd7-78c3a1e31f30', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8c8db4-66c9-4e0f-9a46-ba4ba3a96ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c8c8db4-66c9-4e0f-9a46-ba4ba3a96ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcd22be-422a-43be-b7ad-39bbe9871854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Volume 9cab5642-6543-4915-9cd7-78c3a1e31f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cab5642-6543-4915-9cd7-78c3a1e31f30', 'volume_size': 1}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1888272613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cab5642-6543-4915-9cd7-78c3a1e31f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:14Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Creating volume 9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:57:14 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:57:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:14 devstack sudo[106515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 1073741824
Jul 07 03:57:14 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:15 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 1073741824" returned: 0 in 0.798s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:15 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30
Jul 07 03:57:15 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:15 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:57:15 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:15 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30" returned: 0 in 0.629s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bcd22be-422a-43be-b7ad-39bbe9871854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cab5642-6543-4915-9cd7-78c3a1e31f30', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc6e860-7b17-4659-976e-4f291a6269d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:15 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Volume volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 (9cab5642-6543-4915-9cd7-78c3a1e31f30): created successfully
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc6e860-7b17-4659-976e-4f291a6269d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:15 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (42256760-06c2-4de4-a142-ecc38ef4aca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:15 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-048b484a-02ba-40c5-bfdd-6985dff3c574 tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:57:15 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.627s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 95b1c666-2410-40b7-801e-85f927e7ecca of volume 9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5ff13a-277a-499c-b850-b2a7fe486ada]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:16 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30
Jul 07 03:57:16 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:17 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30" returned: 0 in 0.737s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:17 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca 1G
Jul 07 03:57:17 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:17 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca 1G" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:17 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca
Jul 07 03:57:17 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:18 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca" returned: 0 in 0.698s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca is being set with open permissions: ugo+rw
Jul 07 03:57:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:18 devstack sudo[106543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca
Jul 07 03:57:18 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:19 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca" returned: 0 in 0.647s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:19 devstack sudo[106546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info
Jul 07 03:57:19 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:19 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:19 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info is being set with open permissions: ugo+rw
Jul 07 03:57:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:19 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info
Jul 07 03:57:19 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:20 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.info" returned: 0 in 0.635s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.268s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:20 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e541ccff-65ee-46ca-a9ff-ff571e899d3e tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-95b1c666-2410-40b7-801e-85f927e7ecca-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-95b1c666-2410-40b7-801e-85f927e7ecca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-95b1c666-2410-40b7-801e-85f927e7ecca" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-95b1c666-2410-40b7-801e-85f927e7ecca" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 95b1c666-2410-40b7-801e-85f927e7ecca of volume 9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a412d4f6-d23c-4864-be01-4c378be53666]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:21 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca
Jul 07 03:57:21 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:22 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca" returned: 0 in 0.745s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:22 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cab5642-6543-4915-9cd7-78c3a1e31f30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:57:22 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d8eb6e-9d8c-447a-b3db-63fe5c548312]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:22 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30
Jul 07 03:57:22 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:23 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30" returned: 0 in 0.738s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:23 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca
Jul 07 03:57:23 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:23 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca" returned: 0 in 0.702s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:23 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca
Jul 07 03:57:23 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:24 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30.95b1c666-2410-40b7-801e-85f927e7ecca" returned: 0 in 0.628s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-95b1c666-2410-40b7-801e-85f927e7ecca" released by "_delete_snapshot" :: held 2.901s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" released by "delete_snapshot" :: held 2.919s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Created reservations ['f9164c5f-e48a-4488-a46e-6e6ee30a5851', 'b590204b-b336-46e5-9f00-6a731bfdf804', '745c1c0f-c491-47f6-977d-970be394ab90', '22c36bae-0257-47b8-aa95-6f261ce0c14d'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:24 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a50b9092-2cf0-4a16-8503-71fe9689dd20 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-95b1c666-2410-40b7-801e-85f927e7ecca-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-9cab5642-6543-4915-9cd7-78c3a1e31f30-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-9cab5642-6543-4915-9cd7-78c3a1e31f30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f3276-4de8-43cb-8f8e-f2c697de4876]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:24 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30
Jul 07 03:57:24 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:25 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:25 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30
Jul 07 03:57:25 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:26 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-9cab5642-6543-4915-9cd7-78c3a1e31f30" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-9cab5642-6543-4915-9cd7-78c3a1e31f30" released by "delete_volume" :: held 1.452s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Created reservations ['05bab279-167e-4fcd-ae1c-1a20028819e2', '49e81a12-8374-492b-aaec-ff85c8ef5012', 'c0162fea-991c-4792-8220-be77d3b545a0', 'eb90ba51-1043-47fd-ae68-63a62002c5b5'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:26 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:57:26 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:27 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.641s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-c3a5a0eb-e786-4b0d-94eb-85ffe3e4ca89 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-9cab5642-6543-4915-9cd7-78c3a1e31f30-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (1a20b66f-9cde-4a63-96d1-302a4503778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b9e56-1c94-4d43-b508-3ac2717127df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b9e56-1c94-4d43-b508-3ac2717127df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618943910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec8c122-f9cb-4bb1-854e-4e847c0315d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:27Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0460928e-1dfd-4d4d-8f93-cca7f151740e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0460928e-1dfd-4d4d-8f93-cca7f151740e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a470b1f-bd3b-4e8f-9c9b-df428d0f7d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a470b1f-bd3b-4e8f-9c9b-df428d0f7d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec8c122-f9cb-4bb1-854e-4e847c0315d1', 'volume_name': 'volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f8195c-6c25-4d3b-89ff-c37f50ec4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f8195c-6c25-4d3b-89ff-c37f50ec4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0348739-5a4b-42b3-b178-359d5afd9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Volume 3ec8c122-f9cb-4bb1-854e-4e847c0315d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1', 'volume_size': 1}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618943910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec8c122-f9cb-4bb1-854e-4e847c0315d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fbbb31728e4e9cac5052f0ef4c1f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:27Z,use_quota=True,user_id='a2eb8736cf234b32944e34ad85b50040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Creating volume 3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:57:27 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:57:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:27 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 1073741824
Jul 07 03:57:27 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:28 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 1073741824" returned: 0 in 0.816s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:28 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1
Jul 07 03:57:28 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:28 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0348739-5a4b-42b3-b178-359d5afd9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e83865f-83f7-44e8-99ad-00f97626944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:28 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Volume volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 (3ec8c122-f9cb-4bb1-854e-4e847c0315d1): created successfully
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e83865f-83f7-44e8-99ad-00f97626944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:28 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Flow 'volume_create_manager' (1a20b66f-9cde-4a63-96d1-302a4503778b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:29 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7557baad-752f-4376-967b-9166d67aeced tempest-ProjectMemberTests-1617340040 None] Created volume successfully.
Jul 07 03:57:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:29 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Creating offline snapshot 776727fa-964f-42ab-aa94-ed4c9892508c of volume 3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:57:29 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7c3151-43ca-4465-82e2-d301900c48de]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:29 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1
Jul 07 03:57:29 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:30 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" returned: 0 in 0.732s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:30 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c 1G
Jul 07 03:57:30 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:31 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c 1G" returned: 0 in 0.763s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:31 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c
Jul 07 03:57:31 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:31 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c" returned: 0 in 0.660s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c is being set with open permissions: ugo+rw
Jul 07 03:57:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:31 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c
Jul 07 03:57:31 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:32 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c" returned: 0 in 0.617s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:32 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info
Jul 07 03:57:32 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:33 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info" returned: 0 in 0.624s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:33 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info is being set with open permissions: ugo+rw
Jul 07 03:57:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:33 devstack sudo[106615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info
Jul 07 03:57:33 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:33 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.info" returned: 0 in 0.640s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:33 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-5e76cf38-422c-4bbd-ad60-bdb70d8d4ac1 tempest-ProjectMemberTests-1617340040 None] Create snapshot completed successfully
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-776727fa-964f-42ab-aa94-ed4c9892508c-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-776727fa-964f-42ab-aa94-ed4c9892508c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-776727fa-964f-42ab-aa94-ed4c9892508c" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-776727fa-964f-42ab-aa94-ed4c9892508c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Deleting offline snapshot 776727fa-964f-42ab-aa94-ed4c9892508c of volume 3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] snapshot_file for this snap is: volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c530864-95ca-480b-99c8-5767200b218e]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:35 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c
Jul 07 03:57:35 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:35 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c" returned: 0 in 0.742s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:35 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:57:35 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7683b81-8ff2-4526-b16d-4b2bcd679bca]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:35 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1
Jul 07 03:57:35 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:36 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" returned: 0 in 0.742s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:36 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c
Jul 07 03:57:36 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:37 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:37 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c
Jul 07 03:57:37 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:37 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1.776727fa-964f-42ab-aa94-ed4c9892508c" returned: 0 in 0.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-776727fa-964f-42ab-aa94-ed4c9892508c" released by "_delete_snapshot" :: held 2.909s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" released by "delete_snapshot" :: held 2.929s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Created reservations ['a9f45cef-124b-4511-913e-f2b729f49b55', '2927027e-fcce-404f-8a18-98a9186952e8', 'd9ac05a0-25ac-4632-a0ef-14762796df4e', 'cae87986-e86b-46e6-a254-e487f3a072fb'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:37 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Delete snapshot completed successfully.
Jul 07 03:57:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-08b50860-5550-4379-974b-db76d670db57 tempest-ProjectMemberTests-1617340040 None] Lock "cinder-776727fa-964f-42ab-aa94-ed4c9892508c-delete_snapshot" released by "delete_snapshot" :: held 3.051s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-3ec8c122-f9cb-4bb1-854e-4e847c0315d1-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "cinder-3ec8c122-f9cb-4bb1-854e-4e847c0315d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Acquiring lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" acquired by "delete_volume" :: waited 0.021s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[922aea32-039c-488c-860f-f46c9bf4f121]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:38 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1
Jul 07 03:57:38 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:38 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" returned: 0 in 0.777s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:39 devstack sudo[106642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1
Jul 07 03:57:39 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:39 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" returned: 0 in 0.639s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "cinder-quobyte-3ec8c122-f9cb-4bb1-854e-4e847c0315d1" released by "delete_volume" :: held 1.474s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Created reservations ['0546eecc-b050-4ffc-b700-80e610aa88ae', '64e52e43-7725-45bf-b900-60cdc62724b8', '8eb5182e-fee6-4208-9f4c-9cb0addf4d97', '50f86e35-6226-441f-86bc-f933ef9735cf'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:39 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:57:39 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:40 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.655s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:40 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:40 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Deleted volume successfully.
Jul 07 03:57:40 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-bda9f436-1264-4a4e-936d-63a32693dc7c tempest-ProjectMemberTests-1617340040 None] Lock "cinder-3ec8c122-f9cb-4bb1-854e-4e847c0315d1-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (43695b67-cb3a-4436-9f4c-c0f6444f8ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135f2ca8-0c81-4659-aca5-f7b32c13c7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135f2ca8-0c81-4659-aca5-f7b32c13c7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050271681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7be4c9-6f52-494b-a66e-9b6ece5cfae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:44Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045418f-e6ad-4c0a-bb1b-7061b328fac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0045418f-e6ad-4c0a-bb1b-7061b328fac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721325b5-7b0e-48ad-a070-03d96d6930cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721325b5-7b0e-48ad-a070-03d96d6930cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7be4c9-6f52-494b-a66e-9b6ece5cfae8', 'volume_name': 'volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a5e54a-4074-4237-9184-ae14de680db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a5e54a-4074-4237-9184-ae14de680db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7783bc5-0f06-4704-86ed-64e1ed247da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:43 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Volume 7e7be4c9-6f52-494b-a66e-9b6ece5cfae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8', 'volume_size': 1}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1050271681',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7be4c9-6f52-494b-a66e-9b6ece5cfae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:44Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Creating volume 7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:57:43 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:57:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:43 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 1073741824
Jul 07 03:57:43 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:44 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 1073741824" returned: 0 in 0.825s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:44 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8
Jul 07 03:57:44 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:45 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7783bc5-0f06-4704-86ed-64e1ed247da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15594997-6451-4eee-a711-84c5bcab4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:45 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Volume volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 (7e7be4c9-6f52-494b-a66e-9b6ece5cfae8): created successfully
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15594997-6451-4eee-a711-84c5bcab4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (43695b67-cb3a-4436-9f4c-c0f6444f8ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:45 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a98a661a-fcb2-44b8-b4e1-f937943a4b8b tempest-ProjectReaderTests-1592204932 None] Created volume successfully.
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Creating offline snapshot 779ab205-8ba4-447e-9f6d-144d11ba47e8 of volume 7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ef1af-cb2b-4a5c-83e9-c0849efc170c]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:46 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8
Jul 07 03:57:46 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:46 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" returned: 0 in 0.754s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:46 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 1G
Jul 07 03:57:46 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:47 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 1G" returned: 0 in 0.788s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:47 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8
Jul 07 03:57:47 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:48 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8" returned: 0 in 0.664s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:48 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 is being set with open permissions: ugo+rw
Jul 07 03:57:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:48 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8
Jul 07 03:57:48 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:48 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:48 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info
Jul 07 03:57:48 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:49 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info" returned: 0 in 0.638s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:49 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info is being set with open permissions: ugo+rw
Jul 07 03:57:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:49 devstack sudo[106717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info
Jul 07 03:57:49 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:50 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.info" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.192s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-979c6762-97a7-46ed-8ae5-ecdd62c636d4 tempest-ProjectReaderTests-1592204932 None] Create snapshot completed successfully
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-779ab205-8ba4-447e-9f6d-144d11ba47e8-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-779ab205-8ba4-447e-9f6d-144d11ba47e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-779ab205-8ba4-447e-9f6d-144d11ba47e8" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-779ab205-8ba4-447e-9f6d-144d11ba47e8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Deleting offline snapshot 779ab205-8ba4-447e-9f6d-144d11ba47e8 of volume 7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] snapshot_file for this snap is: volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[0343e6f7-d546-491c-b2b5-f8e1bbc9125b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:51 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8
Jul 07 03:57:51 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:52 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8" returned: 0 in 0.755s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[9741263a-744e-474e-8e41-58d53da4c3c8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:52 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8
Jul 07 03:57:52 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:52 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:52 devstack sudo[106731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8
Jul 07 03:57:52 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:53 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:53 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8
Jul 07 03:57:53 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:54 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:54 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8.779ab205-8ba4-447e-9f6d-144d11ba47e8" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-779ab205-8ba4-447e-9f6d-144d11ba47e8" released by "_delete_snapshot" :: held 2.998s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" released by "delete_snapshot" :: held 3.020s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:54 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Created reservations ['98edc150-5bfe-49ad-9719-08689def3167', '85150179-35a0-492b-a179-54edbd1c8746', 'f89d474e-f67b-4a8e-a4f1-5a15749c4565', '3f5684e1-8eb8-45c5-bf12-97a7d510ccb9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:54 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Delete snapshot completed successfully.
Jul 07 03:57:54 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-fdf05667-f4ad-4733-b0d3-1dd019478acf tempest-ProjectReaderTests-1592204932 None] Lock "cinder-779ab205-8ba4-447e-9f6d-144d11ba47e8-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" acquired by "delete_volume" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a43e7-1c17-4e4c-8424-0e03bd55e27b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:57:55 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:55 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8
Jul 07 03:57:55 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:56 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" returned: 0 in 0.760s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:56 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:56 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8
Jul 07 03:57:56 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:57 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" returned: 0 in 0.656s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8" released by "delete_volume" :: held 1.473s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Created reservations ['11779d48-9d05-46e7-b4d9-bcc2719204f4', '38673ed4-8d74-4fa5-b6cd-eefebd43c060', '6145e1b1-8f8d-4315-9749-9518a1d4b8e7', 'b4c93106-4593-4dda-9b73-4145f3194164'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:57 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:57:57 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:57 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.638s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:57:57 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Deleted volume successfully.
Jul 07 03:57:57 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-e1615b82-ae9f-4627-a80a-0d865fe92425 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-7e7be4c9-6f52-494b-a66e-9b6ece5cfae8-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (b5849142-450f-4cfc-bb30-5ff5fdcf3f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f040bf-2d82-4c82-8963-18023b6d1722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f040bf-2d82-4c82-8963-18023b6d1722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100774380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a7a92-ab79-4d86-82cf-4761971fdd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:58Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064648a5-ca86-4ebf-928f-e7216230216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064648a5-ca86-4ebf-928f-e7216230216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561b3f8-cb31-474a-9f15-ea0a2fc2390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561b3f8-cb31-474a-9f15-ea0a2fc2390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1a7a92-ab79-4d86-82cf-4761971fdd23', 'volume_name': 'volume-de1a7a92-ab79-4d86-82cf-4761971fdd23', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc695e26-e404-4b20-92d9-a848290d107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc695e26-e404-4b20-92d9-a848290d107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f1cbc-3791-43ef-a24e-eae30985c963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:58 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Volume de1a7a92-ab79-4d86-82cf-4761971fdd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1a7a92-ab79-4d86-82cf-4761971fdd23', 'volume_size': 1}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2100774380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1a7a92-ab79-4d86-82cf-4761971fdd23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:57:58Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Creating volume de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:57:58 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:57:58 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:58 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 1073741824
Jul 07 03:57:58 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:59 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 1073741824" returned: 0 in 0.809s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:57:59 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23
Jul 07 03:57:59 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:57:59 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23" returned: 0 in 0.636s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f1cbc-3791-43ef-a24e-eae30985c963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1a7a92-ab79-4d86-82cf-4761971fdd23', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4252985-5204-477a-9b96-cb233b878b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:57:59 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Volume volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 (de1a7a92-ab79-4d86-82cf-4761971fdd23): created successfully
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4252985-5204-477a-9b96-cb233b878b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:57:59 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (b5849142-450f-4cfc-bb30-5ff5fdcf3f0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:57:59 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-cdfd8f06-7b0c-4186-bce0-85c6b3f29de1 tempest-ProjectReaderTests-1592204932 None] Created volume successfully.
Jul 07 03:58:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:00 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Creating offline snapshot 0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 of volume de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:58:00 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[850ea454-5733-406a-a712-b15196340cf0]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:00 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:00 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23
Jul 07 03:58:00 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:01 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:01 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 1G
Jul 07 03:58:01 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:01 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 1G" returned: 0 in 0.800s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:01 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:01 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5
Jul 07 03:58:01 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:02 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" returned: 0 in 0.703s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:02 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 is being set with open permissions: ugo+rw
Jul 07 03:58:02 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:02 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5
Jul 07 03:58:02 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:03 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" returned: 0 in 0.648s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:UPDATE=78,cinder:DELETE=5,cinder:SELECT=60,cinder:INSERT=19 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=56,cinder:INSERT=21,cinder:UPDATE=70,cinder:DELETE=8 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:03 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info
Jul 07 03:58:03 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:03 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info" returned: 0 in 0.650s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:03 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info is being set with open permissions: ugo+rw
Jul 07 03:58:03 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:04 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info
Jul 07 03:58:04 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:04 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.info" returned: 0 in 0.652s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:04 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.282s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:04 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-6cc45f18-1a6e-48ec-8788-bdf27e2edb18 tempest-ProjectReaderTests-1592204932 None] Create snapshot completed successfully
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Deleting offline snapshot 0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 of volume de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] snapshot_file for this snap is: volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc64f0b-bae6-4dad-a4cd-234139343d32]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:05 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:05 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5
Jul 07 03:58:05 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:06 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:06 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de1a7a92-ab79-4d86-82cf-4761971fdd23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:58:06 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[a017b0d1-e521-4db6-8ab7-edf618657750]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:06 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:06 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23
Jul 07 03:58:06 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:07 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23" returned: 0 in 0.757s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:07 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5
Jul 07 03:58:07 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:07 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" returned: 0 in 0.711s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:07 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:07 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5
Jul 07 03:58:07 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:08 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:08 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23.0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" returned: 0 in 0.632s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5" released by "_delete_snapshot" :: held 2.973s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" released by "delete_snapshot" :: held 3.000s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:08 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Created reservations ['795e29bd-ca77-48f2-a1e5-2823f0fa5ab6', 'ed38cc15-32b8-4c18-a071-ed0f8e62e2f4', '5d95c80d-d6a1-4457-b052-a1d4394ecc31', 'f716aa47-0ae9-40ad-941f-6e37626b6cb1'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:08 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Delete snapshot completed successfully.
Jul 07 03:58:08 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-a3501ba4-0d68-4b93-a96b-d21fadc97245 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-0da9f12b-3135-4b56-bf3d-e8f53a3a7ae5-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-de1a7a92-ab79-4d86-82cf-4761971fdd23-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "cinder-de1a7a92-ab79-4d86-82cf-4761971fdd23-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[73105cd1-b75b-46d0-9199-1b3c69dec8f2]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:09 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:10 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23
Jul 07 03:58:10 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:10 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:10 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:10 devstack sudo[106817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23
Jul 07 03:58:10 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:11 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-de1a7a92-ab79-4d86-82cf-4761971fdd23" returned: 0 in 0.634s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-de1a7a92-ab79-4d86-82cf-4761971fdd23" released by "delete_volume" :: held 1.454s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Created reservations ['27162cd9-95c1-4796-888c-ae7f77523517', '75a6f7df-e693-49ac-8f8a-78cdf5df8263', '891e9778-4417-4c27-8b3f-2d8342441b85', 'e42a19aa-c647-45e9-a51b-f7d413158a4b'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:11 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:11 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:58:11 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:12 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.667s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:58:12 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Deleted volume successfully.
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-d1aa0d9b-a954-48f1-bb73-747547fb41fe tempest-ProjectReaderTests-1592204932 None] Lock "cinder-de1a7a92-ab79-4d86-82cf-4761971fdd23-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (d55c2f2a-5740-4924-abf7-0d837eceee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb79a5d-81ec-400f-a9b2-fd728a0531e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb79a5d-81ec-400f-a9b2-fd728a0531e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326866443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:12Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af3f45d-fc0f-4006-8830-5d3aa930574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af3f45d-fc0f-4006-8830-5d3aa930574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f5f3fa-4ef7-4976-92e5-2d9bf10b82e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f5f3fa-4ef7-4976-92e5-2d9bf10b82e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4', 'volume_name': 'volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ab5ecd-c677-4d1b-b365-21da753b5aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ab5ecd-c677-4d1b-b365-21da753b5aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16342b72-1cbb-4cd1-8727-83cb81963626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:12 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Volume 0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4', 'volume_size': 1}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326866443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:12Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Creating volume 0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:58:12 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:58:12 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:12 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 1073741824
Jul 07 03:58:12 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:13 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 1073741824" returned: 0 in 0.811s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:13 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:13 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4
Jul 07 03:58:13 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:14 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" returned: 0 in 0.645s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16342b72-1cbb-4cd1-8727-83cb81963626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727cd43e-b0b2-4452-859e-8966476d86f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:14 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Volume volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 (0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4): created successfully
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (727cd43e-b0b2-4452-859e-8966476d86f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (d55c2f2a-5740-4924-abf7-0d837eceee22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:14 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-2c771fe7-973b-4cc0-934a-679ac1f47339 tempest-ProjectReaderTests-1592204932 None] Created volume successfully.
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Creating offline snapshot c204ffe8-cca4-4bce-8d10-623b1384d7f5 of volume 0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3995c21-7976-43bd-ab06-d74d174572d7]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:14 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:14 devstack sudo[106831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4
Jul 07 03:58:14 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:15 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:58:15 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:15 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" returned: 0 in 0.752s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:15 devstack sudo[106838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 1G
Jul 07 03:58:15 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:16 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.643s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 03:58:16 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 1G" returned: 0 in 0.804s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:16 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5
Jul 07 03:58:16 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:16 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5" returned: 0 in 0.696s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:16 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 is being set with open permissions: ugo+rw
Jul 07 03:58:16 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:16 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5
Jul 07 03:58:16 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:17 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5" returned: 0 in 0.630s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:17 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:17 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info
Jul 07 03:58:17 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:18 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info" returned: 0 in 0.635s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:18 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info is being set with open permissions: ugo+rw
Jul 07 03:58:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:18 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info
Jul 07 03:58:18 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:18 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.info" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:18 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:18 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-8e9b1553-7383-42d1-8898-65a820a6520f tempest-ProjectReaderTests-1592204932 None] Create snapshot completed successfully
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-c204ffe8-cca4-4bce-8d10-623b1384d7f5-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-c204ffe8-cca4-4bce-8d10-623b1384d7f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-c204ffe8-cca4-4bce-8d10-623b1384d7f5" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-c204ffe8-cca4-4bce-8d10-623b1384d7f5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Deleting offline snapshot c204ffe8-cca4-4bce-8d10-623b1384d7f5 of volume 0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] snapshot_file for this snap is: volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca49c528-7406-41b4-bb5e-a5c7105cdc94]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:19 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:20 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5
Jul 07 03:58:20 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:20 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:20 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:58:20 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1169161e-1b13-4883-b189-edd0c2722eb2]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:20 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:20 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4
Jul 07 03:58:20 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:21 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" returned: 0 in 0.765s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:21 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:21 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5
Jul 07 03:58:21 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:22 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5" returned: 0 in 0.720s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:22 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5
Jul 07 03:58:22 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:22 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4.c204ffe8-cca4-4bce-8d10-623b1384d7f5" returned: 0 in 0.644s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-c204ffe8-cca4-4bce-8d10-623b1384d7f5" released by "_delete_snapshot" :: held 2.983s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" released by "delete_snapshot" :: held 3.003s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:22 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Created reservations ['a67d4f3b-5853-4af7-b128-483388fa3bd5', '52049c2b-d65a-4165-8bff-b7ad15a31c6e', 'f2e5fb8b-c9e5-4557-bacf-eb7b9b5f9a94', '6ab87367-3fe6-461b-82d3-a29a491a6701'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:22 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Delete snapshot completed successfully.
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-1c222d7c-b908-4e93-9105-dbf86194360f tempest-ProjectReaderTests-1592204932 None] Lock "cinder-c204ffe8-cca4-4bce-8d10-623b1384d7f5-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e462302-f139-4f8e-9ee5-2eadd75254c8]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:23 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4
Jul 07 03:58:23 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:23 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" returned: 0 in 0.748s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:23 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:23 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4
Jul 07 03:58:23 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:24 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4" released by "delete_volume" :: held 1.452s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Created reservations ['d164338e-07f8-43a7-9356-a8efd92dd8fe', '470093e7-9ff7-488f-84c8-e868d8b5af3e', '4ba2e722-2d2b-43e4-b741-44426858575b', 'cf410b06-157a-4ba5-b9f7-ef3fbfabc8b9'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:24 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:24 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:58:24 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:25 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.631s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:58:25 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Deleted volume successfully.
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-58f7e450-d375-490d-a477-d387d5ec5430 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-0a0c5314-f7cf-4c0d-941e-ea7d6225e2f4-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (d771d5cb-2586-4921-86a8-dfad215412de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e66cba-f856-4982-b756-43dbc221a0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e66cba-f856-4982-b756-43dbc221a0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585843410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:26Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115b4857-ab5e-49e9-9d51-e03b9855d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115b4857-ab5e-49e9-9d51-e03b9855d219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89e8944-f781-4632-8c39-7aca375b2253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89e8944-f781-4632-8c39-7aca375b2253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40', 'volume_name': 'volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46373f77-fd81-422a-96ef-1ab3fe2cb7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46373f77-fd81-422a-96ef-1ab3fe2cb7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03a6f46-50f1-448c-b6cd-b944e269c2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:25 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Volume fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40', 'volume_size': 1}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-585843410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:26Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Creating volume fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:58:25 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:58:25 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:25 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 1073741824
Jul 07 03:58:25 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:26 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 1073741824" returned: 0 in 0.791s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:26 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:26 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40
Jul 07 03:58:26 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:27 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" returned: 0 in 0.625s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03a6f46-50f1-448c-b6cd-b944e269c2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b31e34-9dd6-44c2-b8c1-0767f66ab54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:27 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Volume volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 (fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40): created successfully
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b31e34-9dd6-44c2-b8c1-0767f66ab54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (d771d5cb-2586-4921-86a8-dfad215412de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:27 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-ba8bae0a-0b8e-4b92-9f0e-e65c9280c73e tempest-ProjectReaderTests-1592204932 None] Created volume successfully.
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Creating offline snapshot bc42c808-d077-467a-94b7-40e72c21b8f4 of volume fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aece9f-7722-4e56-a189-289f6cc362fb]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:27 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:28 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40
Jul 07 03:58:28 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" returned: 0 in 0.746s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:28 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:28 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 1G
Jul 07 03:58:28 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:29 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 1G" returned: 0 in 0.779s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:29 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:29 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4
Jul 07 03:58:29 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:30 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4" returned: 0 in 0.671s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:30 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 is being set with open permissions: ugo+rw
Jul 07 03:58:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:30 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4
Jul 07 03:58:30 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:30 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4" returned: 0 in 0.637s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:30 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:30 devstack sudo[106918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info
Jul 07 03:58:30 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:31 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info" returned: 0 in 0.655s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:31 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info is being set with open permissions: ugo+rw
Jul 07 03:58:31 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:31 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info
Jul 07 03:58:31 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:32 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.info" returned: 0 in 0.633s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:32 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.195s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:32 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-0035be70-3b4d-4abb-a83c-9719c855ae7c tempest-ProjectReaderTests-1592204932 None] Create snapshot completed successfully
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-bc42c808-d077-467a-94b7-40e72c21b8f4-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-bc42c808-d077-467a-94b7-40e72c21b8f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-bc42c808-d077-467a-94b7-40e72c21b8f4" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-bc42c808-d077-467a-94b7-40e72c21b8f4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Deleting offline snapshot bc42c808-d077-467a-94b7-40e72c21b8f4 of volume fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] snapshot_file for this snap is: volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[92183ffa-a093-41f0-8800-8be1ed6c3135]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:33 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4
Jul 07 03:58:33 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:33 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4" returned: 0 in 0.764s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[1192d4bb-b407-423c-8258-7f47b3075eb9]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:33 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:34 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40
Jul 07 03:58:34 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:34 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" returned: 0 in 0.770s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:34 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:34 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4
Jul 07 03:58:34 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:35 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4" returned: 0 in 0.741s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:35 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:35 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4
Jul 07 03:58:35 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:36 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:36 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40.bc42c808-d077-467a-94b7-40e72c21b8f4" returned: 0 in 0.662s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-bc42c808-d077-467a-94b7-40e72c21b8f4" released by "_delete_snapshot" :: held 3.025s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" released by "delete_snapshot" :: held 3.047s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:36 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Created reservations ['bb07dc27-b300-4faa-9b73-a2c1650f9927', '1072711a-86ea-49e1-a9ea-14c86629d7e3', 'fea955aa-3da7-432b-bab9-35b603697e93', 'cdc62699-9d74-439e-977f-f3af1b821219'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:36 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Delete snapshot completed successfully.
Jul 07 03:58:36 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-7c73821d-9133-44aa-bb0b-3c2434d09066 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-bc42c808-d077-467a-94b7-40e72c21b8f4-delete_snapshot" released by "delete_snapshot" :: held 3.177s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" acquired by "delete_volume" :: waited 0.016s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b66ee0a-7929-4c75-bcec-d5323cf37e08]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:37 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:37 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40
Jul 07 03:58:37 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:38 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" returned: 0 in 0.753s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:38 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40
Jul 07 03:58:38 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:38 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" returned: 0 in 0.641s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40" released by "delete_volume" :: held 1.446s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Created reservations ['af0bb28b-ea92-4efe-8d74-a4f8ca828ec6', 'b499900e-0699-442b-9f81-b3c6ab808800', '458c1020-859f-40c1-865f-65c150223094', '6324c08f-0d59-47e1-a5a3-b509b2c5d24e'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:38 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:38 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:58:38 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:39 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:39 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.665s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:39 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:58:39 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Deleted volume successfully.
Jul 07 03:58:39 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-20f9a550-cbf9-4104-85bd-8f020e658ea9 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-fc8b45f2-a7e8-4b0b-91c7-02f71cd4ff40-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:39 devstack cinder-volume[86955]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86955) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 03:58:39 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (cb66a84f-fe5b-46f9-8990-cedc34323b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c7d75c-dfc7-48d8-b140-48ab4c104585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c7d75c-dfc7-48d8-b140-48ab4c104585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823122644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a3e3c7-6b9d-4bb0-8f14-269c6f201840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:40Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a9a545-75c8-46e3-aa1b-24010c0af419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a9a545-75c8-46e3-aa1b-24010c0af419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0814ed-1e75-4c7e-8626-b2bfa81ccbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0814ed-1e75-4c7e-8626-b2bfa81ccbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a3e3c7-6b9d-4bb0-8f14-269c6f201840', 'volume_name': 'volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1659f186-f461-444c-ab3c-9c6b26dba4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1659f186-f461-444c-ab3c-9c6b26dba4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56c271e-ef79-4470-a5c2-ec10f375fb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:40 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Volume 01a3e3c7-6b9d-4bb0-8f14-269c6f201840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840', 'volume_size': 1}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x738b4fd57020>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T01:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1823122644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a3e3c7-6b9d-4bb0-8f14-269c6f201840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396c4fdad0864ab1b8ba5989dbca467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T01:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T01:58:40Z,use_quota=True,user_id='f882f789729a4f938237ab20702a0625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(097739b2-c98c-4425-8896-810ee1f85360),volume_type_id=097739b2-c98c-4425-8896-810ee1f85360)}" {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Creating volume 01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Selected osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6 as target Quobyte volume. {{(pid=86955) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 03:58:40 devstack cinder-volume[86955]: INFO cinder.volume.drivers.remotefs [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] casted to osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 1073741824 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:40 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 1073741824
Jul 07 03:58:40 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:40 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 1073741824" returned: 0 in 0.797s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:40 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:40 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840
Jul 07 03:58:40 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:41 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" returned: 0 in 0.640s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'} {{(pid=86955) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56c271e-ef79-4470-a5c2-ec10f375fb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840', 'volume_size': 1}' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4825adb-f156-49c7-90e2-8bacc50e2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 03:58:41 devstack cinder-volume[86955]: INFO cinder.volume.flows.manager.create_volume [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Volume volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 (01a3e3c7-6b9d-4bb0-8f14-269c6f201840): created successfully
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4825adb-f156-49c7-90e2-8bacc50e2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86955) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 03:58:41 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Flow 'volume_create_manager' (cb66a84f-fe5b-46f9-8990-cedc34323b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86955) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 03:58:41 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-b68c15bf-fb79-422c-8f83-d9a63457412d tempest-ProjectReaderTests-1592204932 None] Created volume successfully.
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Creating offline snapshot c1532af4-b2c7-426e-a460-4fc13364a3ca of volume 01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[82abea9c-1e29-4ef6-b0fa-11cdc6ff5d70]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:42 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840
Jul 07 03:58:42 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:42 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" returned: 0 in 0.745s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:42 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca 1G {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:42 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca 1G
Jul 07 03:58:42 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:43 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca 1G" returned: 0 in 0.789s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:43 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:43 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca
Jul 07 03:58:43 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:44 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 -F qcow2 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca" returned: 0 in 0.690s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:44 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca is being set with open permissions: ugo+rw
Jul 07 03:58:44 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:44 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca
Jul 07 03:58:44 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:45 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca" returned: 0 in 0.644s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:45 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info
Jul 07 03:58:45 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:45 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info" returned: 0 in 0.654s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:45 devstack cinder-volume[86955]: WARNING cinder.volume.drivers.remotefs [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info is being set with open permissions: ugo+rw
Jul 07 03:58:45 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:45 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info
Jul 07 03:58:45 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:46 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.info" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:46 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.261s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:46 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-bb75044e-ed94-41f3-9592-62e15c2c3fa7 tempest-ProjectReaderTests-1592204932 None] Create snapshot completed successfully
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-c1532af4-b2c7-426e-a460-4fc13364a3ca-delete_snapshot" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-c1532af4-b2c7-426e-a460-4fc13364a3ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" by "delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-c1532af4-b2c7-426e-a460-4fc13364a3ca" by "_delete_snapshot" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-c1532af4-b2c7-426e-a460-4fc13364a3ca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Deleting offline snapshot c1532af4-b2c7-426e-a460-4fc13364a3ca of volume 01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] snapshot_file for this snap is: volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668d71d-f66a-4555-8eed-4ffb87be18e4]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:47 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:47 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca
Jul 07 03:58:47 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:48 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca" returned: 0 in 0.802s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:48 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.remotefs [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86955) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 03:58:48 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[5143e32e-d8ad-4a98-b93b-aecc89ff925b]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:48 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:48 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840
Jul 07 03:58:48 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:49 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" returned: 0 in 0.752s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:49 devstack sudo[107032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca
Jul 07 03:58:49 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:49 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca" returned: 0 in 0.731s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:49 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:49 devstack sudo[107038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca
Jul 07 03:58:49 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:50 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:50 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840.c1532af4-b2c7-426e-a460-4fc13364a3ca" returned: 0 in 0.651s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-c1532af4-b2c7-426e-a460-4fc13364a3ca" released by "_delete_snapshot" :: held 3.025s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" released by "delete_snapshot" :: held 3.049s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:50 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Created reservations ['df842fc8-b23d-462f-b293-bf9f8a86bed4', '912b42f4-6402-4b3c-9c74-e0ad31e3bc89', '3a926107-3dea-4b58-9c31-49ff40160cfe', '0e4e2d6c-6b28-439c-a616-3403a8c3f192'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:50 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Delete snapshot completed successfully.
Jul 07 03:58:50 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-31953ae6-9458-4785-9249-2b84b6bdf260 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-c1532af4-b2c7-426e-a460-4fc13364a3ca-delete_snapshot" released by "delete_snapshot" :: held 3.178s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-01a3e3c7-6b9d-4bb0-8f14-269c6f201840-delete_volume" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-01a3e3c7-6b9d-4bb0-8f14-269c6f201840-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" by "delete_volume" {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" acquired by "delete_volume" :: waited 0.013s {{(pid=86955) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG oslo.privsep.daemon [-] privsep: reply[4495d75b-95d7-44ab-98f5-e90e5bba97f3]: (4, 'qcow2') {{(pid=87957) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 03:58:51 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:51 devstack sudo[107041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840
Jul 07 03:58:51 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:52 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" returned: 0 in 0.767s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:52 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:52 devstack sudo[107046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840
Jul 07 03:58:52 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:53 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03/volume-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" returned: 0 in 0.649s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-quobyte-01a3e3c7-6b9d-4bb0-8f14-269c6f201840" released by "delete_volume" :: held 1.471s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.quota [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Created reservations ['df2b4db2-0a30-46bd-b49f-99590f540c3a', 'f6035bb2-45f2-4551-a7b1-ab7d9af74f41', 'b78eba07-5b89-4c2a-a5c1-48762f8cc255', 'fb984728-eee5-4473-821c-98742f9da147'] {{(pid=86955) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:58:53 devstack sudo[107049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:58:53 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:58:53 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.642s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:58:53 devstack cinder-volume[86955]: INFO cinder.volume.manager [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Deleted volume successfully.
Jul 07 03:58:53 devstack cinder-volume[86955]: DEBUG cinder.coordination [None req-614f9cb9-56b6-4114-a63c-4e3a4d151038 tempest-ProjectReaderTests-1592204932 None] Lock "cinder-01a3e3c7-6b9d-4bb0-8f14-269c6f201840-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=86955) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 03:59:03 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=50,cinder:INSERT=19,cinder:UPDATE=72,cinder:DELETE=7 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:59:03 devstack cinder-volume[86955]: DEBUG dbcounter [-] [86955] Writing DB stats cinder:SELECT=55,cinder:UPDATE=64,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86955) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6': None} {{(pid=86955) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG cinder.volume.drivers.quobyte [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-698ff7a3-eb34-4620-97a5-805857d183d6'] {{(pid=86955) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.lockutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86955) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03 {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 03:59:15 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03
Jul 07 03:59:15 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 03:59:15 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Jul 07 03:59:15 devstack cinder-volume[86955]: DEBUG oslo_concurrency.processutils [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30ca5b1381764c5111932c7ce5933e03" returned: 0 in 0.624s {{(pid=86955) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 03:59:16 devstack cinder-volume[86955]: DEBUG cinder.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Notifying Schedulers of capabilities ... {{(pid=86955) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 03:59:16 devstack cinder-volume[86955]: DEBUG oslo_service.periodic_task [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] Running periodic task VolumeManager._thread_info {{(pid=86955) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 03:59:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread count: 28 {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 03:59:16 devstack cinder-volume[86955]: DEBUG cinder.volume.manager [None req-6a1eb263-6e8b-4ec9-b7df-59c707c0f7cb None None] thread info: [<_MainThread(MainThread, started 127042287083648)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127042177609984)>, <Thread(Thread-3 (stat_writer), started daemon 127042174828672)>, <Thread(Rabbit-heartbeat, started daemon 127042177545024)>, <Thread(Thread-5 (_runner), started daemon 127042173626880)>, <Thread(Thread-7 (_runner), started daemon 127042173687680)>, <Thread(fd_logger, started daemon 127042170363648)>, <Thread(privsep_reader, started daemon 127042173872960)>, <Thread(tpool_thread_0, started daemon 127042161702592)>, <Thread(tpool_thread_1, started daemon 127042153309888)>, <Thread(tpool_thread_2, started daemon 127042144917184)>, <Thread(tpool_thread_3, started daemon 127042136508096)>, <Thread(tpool_thread_4, started daemon 127042128099008)>, <Thread(tpool_thread_5, started daemon 127042119689920)>, <Thread(tpool_thread_6, started daemon 127042111280832)>, <Thread(tpool_thread_7, started daemon 127042102871744)>, <Thread(tpool_thread_8, started daemon 127042094462656)>, <Thread(tpool_thread_9, started daemon 127042086053568)>, <Thread(tpool_thread_10, started daemon 127042077644480)>, <Thread(tpool_thread_11, started daemon 127042069235392)>, <Thread(tpool_thread_12, started daemon 127042060826304)>, <Thread(tpool_thread_13, started daemon 127042052417216)>, <Thread(tpool_thread_14, started daemon 127042044008128)>, <Thread(tpool_thread_15, started daemon 127042035599040)>, <Thread(tpool_thread_16, started daemon 127042027189952)>, <Thread(tpool_thread_17, started daemon 127042018780864)>, <Thread(tpool_thread_18, started daemon 127042010371776)>, <Thread(tpool_thread_19, started daemon 127042001962688)>] {{(pid=86955) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}